Nov 10 11:46:29 user nova-compute[74889]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74889) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74889) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74889) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 11:46:29 user nova-compute[74889]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.032s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:46:29 user nova-compute[74889]: INFO nova.virt.driver [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 10 11:46:29 user nova-compute[74889]: INFO nova.compute.provider_config [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] Acquiring lock "singleton_lock" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] Acquired lock "singleton_lock" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] Releasing lock "singleton_lock" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] Full set of CONF: {{(pid=74889) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ******************************************************************************** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] Configuration options gathered from: {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ================================================================================ {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] allow_resize_to_same_host      = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] arq_binding_timeout            = 300 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] backdoor_port                  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] backdoor_socket                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] block_device_allocate_retries  = 300 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] block_device_allocate_retries_interval = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cert                           = self.pem {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute_monitors               = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] config_dir                     = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] config_drive_format            = iso9660 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] config_source                  = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] console_host                   = user {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] control_exchange               = nova {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cpu_allocation_ratio           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] daemon                         = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] debug                          = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] default_access_ip_network_name = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] default_availability_zone      = nova {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] default_ephemeral_format       = ext4 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] default_green_pool_size        = 1000 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] default_schedule_zone          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] disk_allocation_ratio          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] enable_new_services            = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] enabled_apis                   = ['osapi_compute'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] enabled_ssl_apis               = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] flat_injected                  = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] force_config_drive             = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] force_raw_images               = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] graceful_shutdown_timeout      = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] heal_instance_info_cache_interval = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] host                           = user {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] instance_build_timeout         = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] instance_delete_interval       = 300 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] instance_format                = [instance: %(uuid)s]  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] instance_name_template         = instance-%08x {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] instance_usage_audit           = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] instance_usage_audit_period    = month {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] internal_service_availability_zone = internal {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] key                            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] live_migration_retry_count     = 30 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] log_config_append              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] log_dir                        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] log_file                       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] log_options                    = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] log_rotate_interval            = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] log_rotate_interval_type       = days {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] log_rotation_type              = none {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] long_rpc_timeout               = 1800 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] max_concurrent_builds          = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] max_concurrent_live_migrations = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] max_concurrent_snapshots       = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] max_local_block_devices        = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] max_logfile_count              = 30 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] max_logfile_size_mb            = 200 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] maximum_instance_delete_attempts = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] metadata_listen                = 0.0.0.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] metadata_listen_port           = 8775 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] metadata_workers               = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] migrate_max_retries            = -1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] mkisofs_cmd                    = genisoimage {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] my_ip                          = 10.0.0.210 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] network_allocate_retries       = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] osapi_compute_listen_port      = 8774 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] osapi_compute_unique_server_name_scope =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] osapi_compute_workers          = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] password_length                = 12 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] periodic_enable                = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] periodic_fuzzy_delay           = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] pointer_model                  = ps2mouse {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] preallocate_images             = none {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] publish_errors                 = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] pybasedir                      = /opt/stack/nova {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ram_allocation_ratio           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] rate_limit_burst               = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] rate_limit_except_level        = CRITICAL {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] rate_limit_interval            = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] reboot_timeout                 = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] reclaim_instance_interval      = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] record                         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] reimage_timeout_per_gb         = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] report_interval                = 120 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] rescue_timeout                 = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] reserved_host_cpus             = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] reserved_host_disk_mb          = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] reserved_host_memory_mb        = 512 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] reserved_huge_pages            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] resize_confirm_window          = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] resize_fs_using_block_device   = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] resume_guests_state_on_host_boot = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] rpc_response_timeout           = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] run_external_periodic_tasks    = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] running_deleted_instance_action = reap {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] running_deleted_instance_poll_interval = 1800 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] running_deleted_instance_timeout = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler_instance_sync_interval = 120 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_down_time              = 720 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] servicegroup_driver            = db {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] shelved_offload_time           = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] shelved_poll_interval          = 3600 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] shutdown_timeout               = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] source_is_ipv6                 = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ssl_only                       = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] state_path                     = /opt/stack/data/nova {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] sync_power_state_interval      = 600 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] sync_power_state_pool_size     = 1000 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] syslog_log_facility            = LOG_USER {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] tempdir                        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] timeout_nbd                    = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] transport_url                  = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] update_resources_interval      = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] use_cow_images                 = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] use_eventlog                   = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] use_journal                    = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] use_json                       = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] use_rootwrap_daemon            = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] use_stderr                     = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] use_syslog                     = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vcpu_pin_set                   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plugging_is_fatal          = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plugging_timeout           = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] virt_mkfs                      = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] volume_usage_poll_interval     = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] watch_log_file                 = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] web                            = /usr/share/spice-html5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_concurrency.disable_process_locking = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.auth_strategy              = keystone {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.compute_link_prefix        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.dhcp_domain                = novalocal {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.enable_instance_password   = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.glance_link_prefix         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.instance_list_per_project_cells = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.list_records_by_skipping_down_cells = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.local_metadata_per_cell    = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.max_limit                  = 1000 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.metadata_cache_expiration  = 15 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.neutron_default_tenant_id  = default {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.use_forwarded_for          = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.use_neutron_default_nets   = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.vendordata_dynamic_targets = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.vendordata_jsonfile_path   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.backend                  = dogpile.cache.memcached {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.backend_argument         = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.config_prefix            = cache.oslo {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.dead_timeout             = 60.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.debug_cache_backend      = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.enable_retry_client      = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.enable_socket_keepalive  = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.enabled                  = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.expiration_time          = 600 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.hashclient_retry_attempts = 2 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.memcache_dead_retry      = 300 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.memcache_password        =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.memcache_pool_maxsize    = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.memcache_sasl_enabled    = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.memcache_username        =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.proxies                  = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.retry_attempts           = 2 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.retry_delay              = 0.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.socket_keepalive_count   = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.socket_keepalive_idle    = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.socket_keepalive_interval = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.tls_allowed_ciphers      = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.tls_cafile               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.tls_certfile             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.tls_enabled              = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cache.tls_keyfile              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.auth_section            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.auth_type               = password {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.cafile                  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.certfile                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.collect_timing          = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.cross_az_attach         = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.debug                   = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.endpoint_template       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.http_retries            = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.insecure                = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.keyfile                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.os_region_name          = RegionOne {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.split_loggers           = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cinder.timeout                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.cpu_dedicated_set      = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.cpu_shared_set         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.image_type_exclude_list = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.max_concurrent_disk_ops = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.max_disk_devices_to_attach = -1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.resource_provider_association_refresh = 300 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.shutdown_retry_interval = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] conductor.workers              = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] console.allowed_origins        = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] console.ssl_ciphers            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] console.ssl_minimum_version    = default {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] consoleauth.token_ttl          = 600 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.cafile                  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.certfile                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.collect_timing          = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.connect_retries         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.connect_retry_delay     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.endpoint_override       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.insecure                = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.keyfile                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.max_version             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.min_version             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.region_name             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.service_name            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.service_type            = accelerator {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.split_loggers           = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.status_code_retries     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.status_code_retry_delay = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.timeout                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] cyborg.version                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.backend               = sqlalchemy {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.connection            = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.connection_debug      = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.connection_parameters =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.connection_recycle_time = 3600 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.connection_trace      = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.db_inc_retry_interval = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.db_max_retries        = 20 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.db_max_retry_interval = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.db_retry_interval     = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.max_overflow          = 50 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.max_pool_size         = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.max_retries           = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.mysql_wsrep_sync_wait = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.pool_timeout          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.retry_interval        = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.slave_connection      = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] database.sqlite_synchronous    = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.backend           = sqlalchemy {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.connection        = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.connection_debug  = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.connection_parameters =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.connection_recycle_time = 3600 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.connection_trace  = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.db_inc_retry_interval = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.db_max_retries    = 20 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.db_max_retry_interval = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.db_retry_interval = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.max_overflow      = 50 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.max_pool_size     = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.max_retries       = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.pool_timeout      = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.retry_interval    = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.slave_connection  = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] api_database.sqlite_synchronous = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] devices.enabled_mdev_types     = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ephemeral_storage_encryption.enabled = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.api_servers             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.cafile                  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.certfile                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.collect_timing          = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.connect_retries         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.connect_retry_delay     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.debug                   = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.default_trusted_certificate_ids = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.enable_certificate_validation = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.enable_rbd_download     = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.endpoint_override       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.insecure                = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.keyfile                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.max_version             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.min_version             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.num_retries             = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.rbd_ceph_conf           =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.rbd_connect_timeout     = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.rbd_pool                =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.rbd_user                =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.region_name             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.service_name            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.service_type            = image {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.split_loggers           = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.status_code_retries     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.status_code_retry_delay = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.timeout                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.verify_glance_signatures = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] glance.version                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] guestfs.debug                  = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.config_drive_cdrom      = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.config_drive_inject_password = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.enable_instance_metrics_collection = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.enable_remotefx         = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.instances_path_share    =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.iscsi_initiator_list    = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.limit_cpu_features      = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.power_state_check_timeframe = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.use_multipath_io        = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.volume_attach_retry_count = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.vswitch_name            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] mks.enabled                    = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] image_cache.manager_interval   = 2400 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] image_cache.precache_concurrency = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] image_cache.remove_unused_base_images = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] image_cache.subdirectory_name  = _base {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.api_max_retries         = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.api_retry_interval      = 2 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.auth_section            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.auth_type               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.cafile                  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.certfile                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.collect_timing          = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.conductor_group         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.connect_retries         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.connect_retry_delay     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.endpoint_override       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.insecure                = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.keyfile                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.max_version             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.min_version             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.peer_list               = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.region_name             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.serial_console_state_timeout = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.service_name            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.service_type            = baremetal {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.split_loggers           = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.status_code_retries     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.status_code_retry_delay = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.timeout                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ironic.version                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] key_manager.fixed_key          = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.barbican_api_version  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.barbican_endpoint     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.barbican_endpoint_type = public {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.barbican_region_name  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.cafile                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.certfile              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.collect_timing        = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.insecure              = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.keyfile               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.number_of_retries     = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.retry_delay           = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.send_service_user_token = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.split_loggers         = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.timeout               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.verify_ssl            = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican.verify_ssl_path       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican_service_user.auth_section = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican_service_user.auth_type = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican_service_user.cafile   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican_service_user.certfile = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican_service_user.collect_timing = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican_service_user.insecure = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican_service_user.keyfile  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican_service_user.split_loggers = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] barbican_service_user.timeout  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.approle_role_id          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.approle_secret_id        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.cafile                   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.certfile                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.collect_timing           = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.insecure                 = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.keyfile                  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.kv_mountpoint            = secret {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.kv_path                  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.kv_version               = 2 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.namespace                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.root_token_id            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.split_loggers            = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.ssl_ca_crt_file          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.timeout                  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.use_ssl                  = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.auth_section          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.auth_type             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.cafile                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.certfile              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.collect_timing        = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.connect_retries       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.connect_retry_delay   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.endpoint_override     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.insecure              = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.keyfile               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.max_version           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.min_version           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.region_name           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.service_name          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.service_type          = identity {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.split_loggers         = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.status_code_retries   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.status_code_retry_delay = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.timeout               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] keystone.version               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.connection_uri         =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.cpu_mode               = custom {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: WARNING oslo_config.cfg [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.cpu_power_governor_high = performance {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.cpu_power_governor_low = powersave {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.cpu_power_management   = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.device_detach_attempts = 8 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.device_detach_timeout  = 20 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.disk_cachemodes        = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.disk_prefix            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.enabled_perf_events    = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.file_backed_memory     = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.gid_maps               = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.hw_disk_discard        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.hw_machine_type        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.images_rbd_glance_store_name =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.images_rbd_pool        = rbd {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.images_type            = default {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.images_volume_group    = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.inject_key             = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.inject_partition       = -2 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.inject_password        = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.iscsi_iface            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.iser_use_multipath     = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_bandwidth = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_downtime = 500 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_inbound_addr = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_permit_post_copy = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_scheme  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_timeout_action = abort {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_tunnelled = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: WARNING oslo_config.cfg [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 10 11:46:29 user nova-compute[74889]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 10 11:46:29 user nova-compute[74889]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 10 11:46:29 user nova-compute[74889]: and ``live_migration_inbound_addr`` respectively.
Nov 10 11:46:29 user nova-compute[74889]: ).  Its value may be silently ignored in the future.
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.live_migration_with_native_tls = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.max_queues             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.nfs_mount_options      = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.num_memory_encrypted_guests = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.num_pcie_ports         = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.pmem_namespaces        = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.quobyte_client_cfg     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.rbd_secret_uuid        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.rbd_user               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.remote_filesystem_transport = ssh {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.rescue_image_id        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.rescue_kernel_id       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.rescue_ramdisk_id      = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.rx_queue_size          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.smbfs_mount_options    =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.snapshot_compression   = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.snapshot_image_format  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.sparse_logical_volumes = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.swtpm_enabled          = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.swtpm_group            = tss {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.swtpm_user             = tss {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.sysinfo_serial         = unique {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.tb_cache_size          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.tx_queue_size          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.uid_maps               = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.use_virtio_for_bridges = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.virt_type              = kvm {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.volume_clear           = zero {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.volume_clear_size      = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.volume_use_multipath   = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.vzstorage_cache_path   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.vzstorage_mount_user   = stack {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.auth_section           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.auth_type              = password {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.cafile                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.certfile               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.collect_timing         = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.connect_retries        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.connect_retry_delay    = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.default_floating_pool  = public {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.endpoint_override      = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.extension_sync_interval = 600 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.http_retries           = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.insecure               = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.keyfile                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.max_version            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.min_version            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.ovs_bridge             = br-int {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.physnets               = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.region_name            = RegionOne {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.service_metadata_proxy = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.service_name           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.service_type           = network {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.split_loggers          = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.status_code_retries    = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.status_code_retry_delay = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.timeout                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] neutron.version                = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] notifications.bdms_in_notifications = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] notifications.default_level    = INFO {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] notifications.notification_format = unversioned {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] notifications.notify_on_state_change = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] pci.alias                      = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] pci.device_spec                = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] pci.report_in_placement        = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.auth_section         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.auth_type            = password {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.cafile               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.certfile             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.collect_timing       = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.connect_retries      = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.connect_retry_delay  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.default_domain_id    = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.default_domain_name  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.domain_id            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.domain_name          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.endpoint_override    = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.insecure             = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.keyfile              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.max_version          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.min_version          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.password             = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.project_domain_id    = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.project_domain_name  = Default {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.project_id           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.project_name         = service {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.region_name          = RegionOne {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.service_name         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.service_type         = placement {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.split_loggers        = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.status_code_retries  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.status_code_retry_delay = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.system_scope         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.timeout              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.trust_id             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.user_domain_id       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.user_domain_name     = Default {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.user_id              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.username             = placement {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] placement.version              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.cores                    = 20 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.count_usage_from_placement = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.injected_file_content_bytes = 10240 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.injected_file_path_length = 255 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.injected_files           = 5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.instances                = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.key_pairs                = 100 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.metadata_items           = 128 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.ram                      = 51200 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.recheck_quota            = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.server_group_members     = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] quota.server_groups            = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] rdp.enabled                    = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler.image_metadata_prefilter = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler.max_attempts         = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler.max_placement_results = 1000 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler.query_placement_for_image_type_support = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] scheduler.workers              = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.host_subset_size = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.isolated_hosts = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.isolated_images = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.pci_in_placement = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.track_instance_changes = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] metrics.required               = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] metrics.weight_multiplier      = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] metrics.weight_setting         = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] serial_console.enabled         = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] serial_console.port_range      = 10000:20000 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] serial_console.serialproxy_port = 6083 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_user.auth_section      = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_user.auth_type         = password {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_user.cafile            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_user.certfile          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_user.collect_timing    = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_user.insecure          = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_user.keyfile           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_user.send_service_user_token = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_user.split_loggers     = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] service_user.timeout           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.agent_enabled            = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.enabled                  = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.html5proxy_port          = 6082 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.image_compression        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.jpeg_compression         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.playback_compression     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.server_listen            = 127.0.0.1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.streaming_mode           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] spice.zlib_compression         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] upgrade_levels.baseapi         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] upgrade_levels.cert            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] upgrade_levels.compute         = auto {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] upgrade_levels.conductor       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] upgrade_levels.scheduler       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vendordata_dynamic_auth.auth_section = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vendordata_dynamic_auth.auth_type = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vendordata_dynamic_auth.cafile = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vendordata_dynamic_auth.certfile = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vendordata_dynamic_auth.insecure = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vendordata_dynamic_auth.keyfile = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vendordata_dynamic_auth.timeout = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.api_retry_count         = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.ca_file                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.cache_prefix            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.cluster_name            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.connection_pool_size    = 10 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.console_delay_seconds   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.datastore_regex         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.host_ip                 = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.host_password           = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.host_port               = 443 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.host_username           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.insecure                = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.integration_bridge      = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.maximum_objects         = 100 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.pbm_default_policy      = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.pbm_enabled             = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.pbm_wsdl_location       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.serial_port_proxy_uri   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.serial_port_service_uri = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.task_poll_interval      = 0.5 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.use_linked_clone        = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.vnc_keymap              = en-us {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.vnc_port                = 5900 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vmware.vnc_port_total          = 10000 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vnc.auth_schemes               = ['none'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vnc.enabled                    = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vnc.novncproxy_port            = 6080 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vnc.server_listen              = 0.0.0.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vnc.vencrypt_ca_certs          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vnc.vencrypt_client_cert       = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vnc.vencrypt_client_key        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.disable_rootwrap   = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.enable_numa_live_migration = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.libvirt_disable_apic = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.client_socket_timeout     = 900 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.default_pool_size         = 1000 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.keep_alive                = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.max_header_line           = 16384 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.ssl_ca_file               = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.ssl_cert_file             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.ssl_key_file              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.tcp_keepidle              = 600 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] zvm.ca_file                    = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] zvm.cloud_connector_url        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] zvm.reachable_timeout          = 300 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_policy.enforce_new_defaults = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_policy.enforce_scope      = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_policy.policy_default_rule = default {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_policy.policy_file        = policy.yaml {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.connection_string     = messaging:// {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.enabled               = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.es_doc_type           = notification {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.es_scroll_size        = 10000 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.es_scroll_time        = 2m {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.filter_error_trace    = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.hmac_keys             = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.sentinel_service_name = mymaster {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.socket_timeout        = 0.1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.trace_requests        = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler.trace_sqlalchemy      = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler_jaeger.process_tags   = {} {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler_jaeger.service_name_prefix = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] profiler_otlp.service_name_prefix = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] remote_debug.host              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] remote_debug.port              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.ssl      = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_notifications.retry = -1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_messaging_notifications.transport_url = **** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.auth_section        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.auth_type           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.cafile              = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.certfile            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.collect_timing      = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.connect_retries     = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.connect_retry_delay = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.endpoint_id         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.endpoint_override   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.insecure            = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.keyfile             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.max_version         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.min_version         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.region_name         = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.service_name        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.service_type        = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.split_loggers       = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.status_code_retries = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.status_code_retry_delay = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.timeout             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.valid_interfaces    = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_limit.version             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_reports.file_event_handler = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] oslo_reports.log_dir           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_ovs_privileged.group  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] vif_plug_ovs_privileged.user   = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_linux_bridge.flat_interface = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_ovs.isolate_vif         = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_vif_ovs.per_port_bridge     = False {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] os_brick.lock_path             = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] privsep_osbrick.capabilities   = [21] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] privsep_osbrick.group          = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] privsep_osbrick.helper_command = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] privsep_osbrick.user           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] nova_sys_admin.group           = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] nova_sys_admin.helper_command  = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] nova_sys_admin.user            = None {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 11:46:29 user nova-compute[74889]: DEBUG oslo_service.service [None req-5e07ec2f-22e3-427b-812a-fe25b087de1e None None] ******************************************************************************** {{(pid=74889) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 10 11:46:29 user nova-compute[74889]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 10 11:46:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Connecting to libvirt: qemu:///system {{(pid=74889) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 10 11:46:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fa3a0582fb0> {{(pid=74889) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 10 11:46:30 user nova-compute[74889]: libvirt:  error : internal error: could not initialize domain event timer
Nov 10 11:46:30 user nova-compute[74889]: WARNING nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 10 11:46:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fa3a0582fb0> {{(pid=74889) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 10 11:46:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Starting native event thread {{(pid=74889) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 10 11:46:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Starting green dispatch thread {{(pid=74889) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 10 11:46:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Starting connection event dispatch thread {{(pid=74889) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 10 11:46:30 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Connection event '1' reason 'None'
Nov 10 11:46:30 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 11:46:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.mount [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Initialising _HostMountState generation 0 {{(pid=74889) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 10 11:46:37 user nova-compute[74889]: INFO nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Libvirt host capabilities <capabilities>
Nov 10 11:46:37 user nova-compute[74889]:   <host>
Nov 10 11:46:37 user nova-compute[74889]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 10 11:46:37 user nova-compute[74889]:     <cpu>
Nov 10 11:46:37 user nova-compute[74889]:       <arch>x86_64</arch>
Nov 10 11:46:37 user nova-compute[74889]:       <model>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <vendor>Intel</vendor>
Nov 10 11:46:37 user nova-compute[74889]:       <microcode version='1070'/>
Nov 10 11:46:37 user nova-compute[74889]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 10 11:46:37 user nova-compute[74889]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='ss'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='vmx'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='pcid'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='osxsave'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='hypervisor'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='arat'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='tsc_adjust'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='md-clear'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='arch-capabilities'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='invtsc'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='rsba'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature name='skip-l1dfl-vmentry'/>
Nov 10 11:46:37 user nova-compute[74889]:       <pages unit='KiB' size='4'/>
Nov 10 11:46:37 user nova-compute[74889]:       <pages unit='KiB' size='2048'/>
Nov 10 11:46:37 user nova-compute[74889]:     </cpu>
Nov 10 11:46:37 user nova-compute[74889]:     <power_management>
Nov 10 11:46:37 user nova-compute[74889]:       <suspend_mem/>
Nov 10 11:46:37 user nova-compute[74889]:       <suspend_disk/>
Nov 10 11:46:37 user nova-compute[74889]:       <suspend_hybrid/>
Nov 10 11:46:37 user nova-compute[74889]:     </power_management>
Nov 10 11:46:37 user nova-compute[74889]:     <iommu support='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     <migration_features>
Nov 10 11:46:37 user nova-compute[74889]:       <live/>
Nov 10 11:46:37 user nova-compute[74889]:       <uri_transports>
Nov 10 11:46:37 user nova-compute[74889]:         <uri_transport>tcp</uri_transport>
Nov 10 11:46:37 user nova-compute[74889]:         <uri_transport>rdma</uri_transport>
Nov 10 11:46:37 user nova-compute[74889]:       </uri_transports>
Nov 10 11:46:37 user nova-compute[74889]:     </migration_features>
Nov 10 11:46:37 user nova-compute[74889]:     <topology>
Nov 10 11:46:37 user nova-compute[74889]:       <cells num='2'>
Nov 10 11:46:37 user nova-compute[74889]:         <cell id='0'>
Nov 10 11:46:37 user nova-compute[74889]:           <memory unit='KiB'>8140616</memory>
Nov 10 11:46:37 user nova-compute[74889]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 10 11:46:37 user nova-compute[74889]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 11:46:37 user nova-compute[74889]:           <distances>
Nov 10 11:46:37 user nova-compute[74889]:             <sibling id='0' value='10'/>
Nov 10 11:46:37 user nova-compute[74889]:             <sibling id='1' value='20'/>
Nov 10 11:46:37 user nova-compute[74889]:           </distances>
Nov 10 11:46:37 user nova-compute[74889]:           <cpus num='6'>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 10 11:46:37 user nova-compute[74889]:           </cpus>
Nov 10 11:46:37 user nova-compute[74889]:         </cell>
Nov 10 11:46:37 user nova-compute[74889]:         <cell id='1'>
Nov 10 11:46:37 user nova-compute[74889]:           <memory unit='KiB'>8255100</memory>
Nov 10 11:46:37 user nova-compute[74889]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 10 11:46:37 user nova-compute[74889]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 11:46:37 user nova-compute[74889]:           <distances>
Nov 10 11:46:37 user nova-compute[74889]:             <sibling id='0' value='20'/>
Nov 10 11:46:37 user nova-compute[74889]:             <sibling id='1' value='10'/>
Nov 10 11:46:37 user nova-compute[74889]:           </distances>
Nov 10 11:46:37 user nova-compute[74889]:           <cpus num='6'>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 10 11:46:37 user nova-compute[74889]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 10 11:46:37 user nova-compute[74889]:           </cpus>
Nov 10 11:46:37 user nova-compute[74889]:         </cell>
Nov 10 11:46:37 user nova-compute[74889]:       </cells>
Nov 10 11:46:37 user nova-compute[74889]:     </topology>
Nov 10 11:46:37 user nova-compute[74889]:     <cache>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 10 11:46:37 user nova-compute[74889]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 10 11:46:37 user nova-compute[74889]:     </cache>
Nov 10 11:46:37 user nova-compute[74889]:     <secmodel>
Nov 10 11:46:37 user nova-compute[74889]:       <model>apparmor</model>
Nov 10 11:46:37 user nova-compute[74889]:       <doi>0</doi>
Nov 10 11:46:37 user nova-compute[74889]:     </secmodel>
Nov 10 11:46:37 user nova-compute[74889]:     <secmodel>
Nov 10 11:46:37 user nova-compute[74889]:       <model>dac</model>
Nov 10 11:46:37 user nova-compute[74889]:       <doi>0</doi>
Nov 10 11:46:37 user nova-compute[74889]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 10 11:46:37 user nova-compute[74889]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 10 11:46:37 user nova-compute[74889]:     </secmodel>
Nov 10 11:46:37 user nova-compute[74889]:   </host>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='alpha'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>clipper</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='armv6l'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>spitz</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>nuri</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>kzm</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sx1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>z2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>tosa</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>n810</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>n800</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>terrier</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>midway</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>microbit</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>verdex</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>highbank</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>akita</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>connex</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>collie</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='armv7l'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>spitz</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>nuri</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>kzm</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sx1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>z2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>tosa</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>n810</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>n800</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>terrier</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>midway</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>microbit</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>verdex</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>highbank</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>akita</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>connex</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>collie</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='aarch64'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>spitz</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>nuri</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>kzm</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sx1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>z2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>tosa</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>n810</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>n800</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>terrier</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>midway</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>microbit</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>verdex</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>raspi3b</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>highbank</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>akita</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>connex</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>collie</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <acpi default='on' toggle='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='cris'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='i686'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>isapc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>microvm</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='kvm'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <pae/>
Nov 10 11:46:37 user nova-compute[74889]:       <nonpae/>
Nov 10 11:46:37 user nova-compute[74889]:       <acpi default='on' toggle='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:       <apic default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='m68k'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>an5206</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>q800</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>next-cube</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='microblaze'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='microblazeel'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='mips'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='16'>malta</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='mipsel'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='16'>malta</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='mips64'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='16'>malta</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>pica61</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>magnum</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='mips64el'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='16'>malta</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>pica61</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>magnum</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='16'>boston</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='ppc'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mac99</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>40p</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>taihu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='ppc64'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>taihu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>40p</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mac99</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='ppc64le'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>taihu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>40p</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>mac99</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='riscv32'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='8'>spike</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>opentitan</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='8'>virt</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='riscv64'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='8'>spike</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>shakti_c</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='8'>virt</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='s390x'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='sh4'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>shix</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>r2d</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='sh4eb'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>shix</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>r2d</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='sparc'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>SS-5</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>SS-20</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>LX</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>SS-4</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>SS-10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>Voyager</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='sparc64'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sun4u</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>niagara</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>sun4v</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='x86_64'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>64</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='1'>isapc</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>microvm</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='kvm'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <acpi default='on' toggle='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:       <apic default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='xtensa'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>sim</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>kc705</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>ml605</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>virt</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>lx200</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>lx60</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]:   <guest>
Nov 10 11:46:37 user nova-compute[74889]:     <os_type>hvm</os_type>
Nov 10 11:46:37 user nova-compute[74889]:     <arch name='xtensaeb'>
Nov 10 11:46:37 user nova-compute[74889]:       <wordsize>32</wordsize>
Nov 10 11:46:37 user nova-compute[74889]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='4'>sim</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>kc705</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>ml605</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>virt</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>lx200</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>lx60</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 11:46:37 user nova-compute[74889]:       <domain type='qemu'/>
Nov 10 11:46:37 user nova-compute[74889]:     </arch>
Nov 10 11:46:37 user nova-compute[74889]:     <features>
Nov 10 11:46:37 user nova-compute[74889]:       <cpuselection/>
Nov 10 11:46:37 user nova-compute[74889]:       <deviceboot/>
Nov 10 11:46:37 user nova-compute[74889]:       <disksnapshot default='on' toggle='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     </features>
Nov 10 11:46:37 user nova-compute[74889]:   </guest>
Nov 10 11:46:37 user nova-compute[74889]: </capabilities>
Nov 10 11:46:37 user nova-compute[74889]: 
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 10 11:46:37 user nova-compute[74889]: <domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 11:46:37 user nova-compute[74889]:   <domain>kvm</domain>
Nov 10 11:46:37 user nova-compute[74889]:   <machine>pc-q35-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:   <arch>i686</arch>
Nov 10 11:46:37 user nova-compute[74889]:   <vcpu max='288'/>
Nov 10 11:46:37 user nova-compute[74889]:   <iothreads supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:   <os supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='firmware'/>
Nov 10 11:46:37 user nova-compute[74889]:     <loader supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>rom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pflash</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='readonly'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>yes</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='secure'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </loader>
Nov 10 11:46:37 user nova-compute[74889]:   </os>
Nov 10 11:46:37 user nova-compute[74889]:   <cpu>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-passthrough' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='hostPassthroughMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='maximum' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='maximumMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-model' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <vendor>Intel</vendor>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ss'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='vmx'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pcid'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='hypervisor'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arat'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='umip'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='md-clear'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibpb'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibrs'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='erms'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='lm'/>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='custom' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>qemu64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>qemu32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>phenom</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>n270</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>kvm64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>coreduo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>core2duo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>athlon</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Westmere</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Snowridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Penryn</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G5</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G4</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G1</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Nehalem</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Rome</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Milan</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Dhyana</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cooperlake</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Conroe</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>486</model>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:   </cpu>
Nov 10 11:46:37 user nova-compute[74889]:   <memoryBacking supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='sourceType'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>file</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>anonymous</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>memfd</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:   </memoryBacking>
Nov 10 11:46:37 user nova-compute[74889]:   <devices>
Nov 10 11:46:37 user nova-compute[74889]:     <disk supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='diskDevice'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>disk</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cdrom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>floppy</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>lun</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='bus'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>fdc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sata</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </disk>
Nov 10 11:46:37 user nova-compute[74889]:     <graphics supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sdl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vnc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>spice</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egl-headless</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </graphics>
Nov 10 11:46:37 user nova-compute[74889]:     <video supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='modelType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cirrus</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vmvga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>qxl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>none</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>bochs</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ramfb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </video>
Nov 10 11:46:37 user nova-compute[74889]:     <hostdev supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='mode'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>subsystem</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='startupPolicy'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>default</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>mandatory</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>requisite</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>optional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='subsysType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pci</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='capsType'/>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='pciBackend'/>
Nov 10 11:46:37 user nova-compute[74889]:     </hostdev>
Nov 10 11:46:37 user nova-compute[74889]:     <rng supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>random</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egd</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>builtin</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </rng>
Nov 10 11:46:37 user nova-compute[74889]:     <filesystem supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='driverType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>path</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>handle</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtiofs</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </filesystem>
Nov 10 11:46:37 user nova-compute[74889]:     <tpm supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-tis</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-crb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>passthrough</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>emulator</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </tpm>
Nov 10 11:46:37 user nova-compute[74889]:   </devices>
Nov 10 11:46:37 user nova-compute[74889]:   <features>
Nov 10 11:46:37 user nova-compute[74889]:     <gic supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     <vmcoreinfo supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <genid supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backingStoreInput supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backup supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <sev supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:   </features>
Nov 10 11:46:37 user nova-compute[74889]: </domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:  {{(pid=74889) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 10 11:46:37 user nova-compute[74889]: <domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 11:46:37 user nova-compute[74889]:   <domain>kvm</domain>
Nov 10 11:46:37 user nova-compute[74889]:   <machine>pc-i440fx-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:   <arch>i686</arch>
Nov 10 11:46:37 user nova-compute[74889]:   <vcpu max='255'/>
Nov 10 11:46:37 user nova-compute[74889]:   <iothreads supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:   <os supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='firmware'/>
Nov 10 11:46:37 user nova-compute[74889]:     <loader supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>rom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pflash</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='readonly'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>yes</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='secure'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </loader>
Nov 10 11:46:37 user nova-compute[74889]:   </os>
Nov 10 11:46:37 user nova-compute[74889]:   <cpu>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-passthrough' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='hostPassthroughMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='maximum' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='maximumMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-model' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <vendor>Intel</vendor>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ss'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='vmx'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pcid'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='hypervisor'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arat'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='umip'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='md-clear'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibpb'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibrs'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='erms'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='lm'/>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='custom' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>qemu64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>qemu32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>phenom</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>n270</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>kvm64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>coreduo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>core2duo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>athlon</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Westmere</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Snowridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Penryn</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G5</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G4</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G1</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Nehalem</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Rome</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Milan</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Dhyana</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cooperlake</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Conroe</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>486</model>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:   </cpu>
Nov 10 11:46:37 user nova-compute[74889]:   <memoryBacking supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='sourceType'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>file</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>anonymous</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>memfd</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:   </memoryBacking>
Nov 10 11:46:37 user nova-compute[74889]:   <devices>
Nov 10 11:46:37 user nova-compute[74889]:     <disk supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='diskDevice'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>disk</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cdrom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>floppy</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>lun</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='bus'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ide</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>fdc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sata</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </disk>
Nov 10 11:46:37 user nova-compute[74889]:     <graphics supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sdl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vnc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>spice</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egl-headless</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </graphics>
Nov 10 11:46:37 user nova-compute[74889]:     <video supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='modelType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cirrus</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vmvga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>qxl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>none</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>bochs</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ramfb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </video>
Nov 10 11:46:37 user nova-compute[74889]:     <hostdev supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='mode'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>subsystem</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='startupPolicy'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>default</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>mandatory</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>requisite</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>optional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='subsysType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pci</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='capsType'/>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='pciBackend'/>
Nov 10 11:46:37 user nova-compute[74889]:     </hostdev>
Nov 10 11:46:37 user nova-compute[74889]:     <rng supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>random</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egd</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>builtin</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </rng>
Nov 10 11:46:37 user nova-compute[74889]:     <filesystem supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='driverType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>path</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>handle</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtiofs</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </filesystem>
Nov 10 11:46:37 user nova-compute[74889]:     <tpm supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-tis</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-crb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>passthrough</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>emulator</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </tpm>
Nov 10 11:46:37 user nova-compute[74889]:   </devices>
Nov 10 11:46:37 user nova-compute[74889]:   <features>
Nov 10 11:46:37 user nova-compute[74889]:     <gic supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     <vmcoreinfo supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <genid supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backingStoreInput supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backup supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <sev supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:   </features>
Nov 10 11:46:37 user nova-compute[74889]: </domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:  {{(pid=74889) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 10 11:46:37 user nova-compute[74889]: <domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 11:46:37 user nova-compute[74889]:   <domain>kvm</domain>
Nov 10 11:46:37 user nova-compute[74889]:   <machine>pc-q35-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:   <arch>i686</arch>
Nov 10 11:46:37 user nova-compute[74889]:   <vcpu max='288'/>
Nov 10 11:46:37 user nova-compute[74889]:   <iothreads supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:   <os supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='firmware'/>
Nov 10 11:46:37 user nova-compute[74889]:     <loader supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>rom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pflash</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='readonly'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>yes</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='secure'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </loader>
Nov 10 11:46:37 user nova-compute[74889]:   </os>
Nov 10 11:46:37 user nova-compute[74889]:   <cpu>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-passthrough' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='hostPassthroughMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='maximum' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='maximumMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-model' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <vendor>Intel</vendor>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ss'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='vmx'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pcid'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='hypervisor'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arat'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='umip'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='md-clear'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibpb'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibrs'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='erms'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='lm'/>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='custom' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>qemu64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>qemu32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>phenom</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>n270</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>kvm64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>coreduo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>core2duo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>athlon</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Westmere</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Snowridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Penryn</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G5</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G4</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G1</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Nehalem</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Rome</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Milan</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Dhyana</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cooperlake</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Conroe</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>486</model>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:   </cpu>
Nov 10 11:46:37 user nova-compute[74889]:   <memoryBacking supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='sourceType'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>file</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>anonymous</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>memfd</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:   </memoryBacking>
Nov 10 11:46:37 user nova-compute[74889]:   <devices>
Nov 10 11:46:37 user nova-compute[74889]:     <disk supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='diskDevice'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>disk</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cdrom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>floppy</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>lun</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='bus'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>fdc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sata</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </disk>
Nov 10 11:46:37 user nova-compute[74889]:     <graphics supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sdl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vnc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>spice</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egl-headless</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </graphics>
Nov 10 11:46:37 user nova-compute[74889]:     <video supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='modelType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cirrus</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vmvga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>qxl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>none</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>bochs</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ramfb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </video>
Nov 10 11:46:37 user nova-compute[74889]:     <hostdev supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='mode'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>subsystem</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='startupPolicy'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>default</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>mandatory</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>requisite</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>optional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='subsysType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pci</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='capsType'/>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='pciBackend'/>
Nov 10 11:46:37 user nova-compute[74889]:     </hostdev>
Nov 10 11:46:37 user nova-compute[74889]:     <rng supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>random</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egd</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>builtin</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </rng>
Nov 10 11:46:37 user nova-compute[74889]:     <filesystem supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='driverType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>path</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>handle</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtiofs</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </filesystem>
Nov 10 11:46:37 user nova-compute[74889]:     <tpm supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-tis</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-crb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>passthrough</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>emulator</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </tpm>
Nov 10 11:46:37 user nova-compute[74889]:   </devices>
Nov 10 11:46:37 user nova-compute[74889]:   <features>
Nov 10 11:46:37 user nova-compute[74889]:     <gic supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     <vmcoreinfo supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <genid supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backingStoreInput supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backup supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <sev supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:   </features>
Nov 10 11:46:37 user nova-compute[74889]: </domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:  {{(pid=74889) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 10 11:46:37 user nova-compute[74889]: <domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 11:46:37 user nova-compute[74889]:   <domain>kvm</domain>
Nov 10 11:46:37 user nova-compute[74889]:   <machine>pc-i440fx-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:   <arch>i686</arch>
Nov 10 11:46:37 user nova-compute[74889]:   <vcpu max='255'/>
Nov 10 11:46:37 user nova-compute[74889]:   <iothreads supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:   <os supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='firmware'/>
Nov 10 11:46:37 user nova-compute[74889]:     <loader supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>rom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pflash</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='readonly'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>yes</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='secure'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </loader>
Nov 10 11:46:37 user nova-compute[74889]:   </os>
Nov 10 11:46:37 user nova-compute[74889]:   <cpu>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-passthrough' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='hostPassthroughMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='maximum' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='maximumMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-model' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <vendor>Intel</vendor>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ss'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='vmx'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pcid'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='hypervisor'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arat'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='umip'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='md-clear'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibpb'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibrs'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='erms'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='lm'/>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='custom' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>qemu64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>qemu32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>phenom</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>n270</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>kvm64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>coreduo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>core2duo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>athlon</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Westmere</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Snowridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Penryn</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G5</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G4</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G1</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Nehalem</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Rome</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Milan</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Dhyana</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cooperlake</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Conroe</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>486</model>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:   </cpu>
Nov 10 11:46:37 user nova-compute[74889]:   <memoryBacking supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='sourceType'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>file</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>anonymous</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>memfd</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:   </memoryBacking>
Nov 10 11:46:37 user nova-compute[74889]:   <devices>
Nov 10 11:46:37 user nova-compute[74889]:     <disk supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='diskDevice'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>disk</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cdrom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>floppy</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>lun</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='bus'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ide</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>fdc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sata</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </disk>
Nov 10 11:46:37 user nova-compute[74889]:     <graphics supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sdl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vnc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>spice</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egl-headless</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </graphics>
Nov 10 11:46:37 user nova-compute[74889]:     <video supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='modelType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cirrus</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vmvga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>qxl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>none</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>bochs</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ramfb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </video>
Nov 10 11:46:37 user nova-compute[74889]:     <hostdev supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='mode'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>subsystem</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='startupPolicy'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>default</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>mandatory</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>requisite</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>optional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='subsysType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pci</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='capsType'/>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='pciBackend'/>
Nov 10 11:46:37 user nova-compute[74889]:     </hostdev>
Nov 10 11:46:37 user nova-compute[74889]:     <rng supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>random</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egd</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>builtin</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </rng>
Nov 10 11:46:37 user nova-compute[74889]:     <filesystem supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='driverType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>path</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>handle</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtiofs</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </filesystem>
Nov 10 11:46:37 user nova-compute[74889]:     <tpm supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-tis</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-crb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>passthrough</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>emulator</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </tpm>
Nov 10 11:46:37 user nova-compute[74889]:   </devices>
Nov 10 11:46:37 user nova-compute[74889]:   <features>
Nov 10 11:46:37 user nova-compute[74889]:     <gic supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     <vmcoreinfo supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <genid supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backingStoreInput supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backup supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <sev supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:   </features>
Nov 10 11:46:37 user nova-compute[74889]: </domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:  {{(pid=74889) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'pc', 'q35', 'ubuntu'} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 10 11:46:37 user nova-compute[74889]: <domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 11:46:37 user nova-compute[74889]:   <domain>kvm</domain>
Nov 10 11:46:37 user nova-compute[74889]:   <machine>pc-q35-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:   <arch>x86_64</arch>
Nov 10 11:46:37 user nova-compute[74889]:   <vcpu max='288'/>
Nov 10 11:46:37 user nova-compute[74889]:   <iothreads supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:   <os supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='firmware'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>efi</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:     <loader supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>rom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pflash</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='readonly'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>yes</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='secure'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>yes</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </loader>
Nov 10 11:46:37 user nova-compute[74889]:   </os>
Nov 10 11:46:37 user nova-compute[74889]:   <cpu>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-passthrough' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='hostPassthroughMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='maximum' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='maximumMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-model' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <vendor>Intel</vendor>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ss'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='vmx'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pcid'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='hypervisor'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arat'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='umip'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='md-clear'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='invtsc'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibpb'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibrs'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='rsba'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='erms'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='custom' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>qemu64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>qemu32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>phenom</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>n270</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>coreduo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>core2duo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>athlon</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Westmere</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Snowridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Penryn</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G5</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G4</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Opteron_G1</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Nehalem</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Rome</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Milan</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Dhyana</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cooperlake</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Conroe</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>486</model>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:   </cpu>
Nov 10 11:46:37 user nova-compute[74889]:   <memoryBacking supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='sourceType'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>file</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>anonymous</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>memfd</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:   </memoryBacking>
Nov 10 11:46:37 user nova-compute[74889]:   <devices>
Nov 10 11:46:37 user nova-compute[74889]:     <disk supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='diskDevice'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>disk</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cdrom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>floppy</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>lun</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='bus'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>fdc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sata</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </disk>
Nov 10 11:46:37 user nova-compute[74889]:     <graphics supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sdl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vnc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>spice</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egl-headless</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </graphics>
Nov 10 11:46:37 user nova-compute[74889]:     <video supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='modelType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cirrus</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vmvga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>qxl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>none</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>bochs</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ramfb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </video>
Nov 10 11:46:37 user nova-compute[74889]:     <hostdev supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='mode'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>subsystem</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='startupPolicy'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>default</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>mandatory</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>requisite</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>optional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='subsysType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pci</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='capsType'/>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='pciBackend'/>
Nov 10 11:46:37 user nova-compute[74889]:     </hostdev>
Nov 10 11:46:37 user nova-compute[74889]:     <rng supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>random</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egd</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>builtin</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </rng>
Nov 10 11:46:37 user nova-compute[74889]:     <filesystem supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='driverType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>path</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>handle</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtiofs</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </filesystem>
Nov 10 11:46:37 user nova-compute[74889]:     <tpm supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-tis</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-crb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>passthrough</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>emulator</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </tpm>
Nov 10 11:46:37 user nova-compute[74889]:   </devices>
Nov 10 11:46:37 user nova-compute[74889]:   <features>
Nov 10 11:46:37 user nova-compute[74889]:     <gic supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     <vmcoreinfo supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <genid supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backingStoreInput supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backup supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <sev supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:   </features>
Nov 10 11:46:37 user nova-compute[74889]: </domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:  {{(pid=74889) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 10 11:46:37 user nova-compute[74889]: <domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 11:46:37 user nova-compute[74889]:   <domain>kvm</domain>
Nov 10 11:46:37 user nova-compute[74889]:   <machine>pc-i440fx-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:   <arch>x86_64</arch>
Nov 10 11:46:37 user nova-compute[74889]:   <vcpu max='255'/>
Nov 10 11:46:37 user nova-compute[74889]:   <iothreads supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:   <os supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='firmware'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>efi</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:     <loader supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>rom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pflash</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='readonly'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>yes</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='secure'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </loader>
Nov 10 11:46:37 user nova-compute[74889]:   </os>
Nov 10 11:46:37 user nova-compute[74889]:   <cpu>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-passthrough' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='hostPassthroughMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='maximum' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='maximumMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-model' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <vendor>Intel</vendor>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ss'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='vmx'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pcid'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='hypervisor'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arat'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='umip'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='md-clear'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='invtsc'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibpb'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibrs'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='rsba'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='erms'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='custom' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>qemu64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>qemu32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>phenom</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>n270</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>coreduo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>core2duo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>athlon</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Westmere</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Snowridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Penryn</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G5</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G4</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Opteron_G1</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Nehalem</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Rome</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Milan</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Dhyana</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cooperlake</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Conroe</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>486</model>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:   </cpu>
Nov 10 11:46:37 user nova-compute[74889]:   <memoryBacking supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='sourceType'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>file</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>anonymous</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>memfd</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:   </memoryBacking>
Nov 10 11:46:37 user nova-compute[74889]:   <devices>
Nov 10 11:46:37 user nova-compute[74889]:     <disk supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='diskDevice'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>disk</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cdrom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>floppy</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>lun</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='bus'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ide</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>fdc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sata</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </disk>
Nov 10 11:46:37 user nova-compute[74889]:     <graphics supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sdl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vnc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>spice</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egl-headless</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </graphics>
Nov 10 11:46:37 user nova-compute[74889]:     <video supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='modelType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cirrus</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vmvga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>qxl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>none</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>bochs</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ramfb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </video>
Nov 10 11:46:37 user nova-compute[74889]:     <hostdev supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='mode'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>subsystem</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='startupPolicy'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>default</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>mandatory</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>requisite</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>optional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='subsysType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pci</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='capsType'/>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='pciBackend'/>
Nov 10 11:46:37 user nova-compute[74889]:     </hostdev>
Nov 10 11:46:37 user nova-compute[74889]:     <rng supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>random</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egd</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>builtin</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </rng>
Nov 10 11:46:37 user nova-compute[74889]:     <filesystem supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='driverType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>path</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>handle</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtiofs</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </filesystem>
Nov 10 11:46:37 user nova-compute[74889]:     <tpm supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-tis</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-crb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>passthrough</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>emulator</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </tpm>
Nov 10 11:46:37 user nova-compute[74889]:   </devices>
Nov 10 11:46:37 user nova-compute[74889]:   <features>
Nov 10 11:46:37 user nova-compute[74889]:     <gic supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     <vmcoreinfo supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <genid supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backingStoreInput supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backup supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <sev supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:   </features>
Nov 10 11:46:37 user nova-compute[74889]: </domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:  {{(pid=74889) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 10 11:46:37 user nova-compute[74889]: <domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 11:46:37 user nova-compute[74889]:   <domain>kvm</domain>
Nov 10 11:46:37 user nova-compute[74889]:   <machine>pc-q35-6.2</machine>
Nov 10 11:46:37 user nova-compute[74889]:   <arch>x86_64</arch>
Nov 10 11:46:37 user nova-compute[74889]:   <vcpu max='288'/>
Nov 10 11:46:37 user nova-compute[74889]:   <iothreads supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:   <os supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='firmware'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>efi</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:     <loader supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>rom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pflash</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='readonly'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>yes</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='secure'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>yes</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </loader>
Nov 10 11:46:37 user nova-compute[74889]:   </os>
Nov 10 11:46:37 user nova-compute[74889]:   <cpu>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-passthrough' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='hostPassthroughMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='maximum' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='maximumMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-model' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <vendor>Intel</vendor>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ss'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='vmx'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pcid'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='hypervisor'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arat'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='umip'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='md-clear'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='invtsc'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibpb'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibrs'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='rsba'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='erms'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='custom' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>qemu64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>qemu32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>phenom</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>n270</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>coreduo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>core2duo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>athlon</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Westmere</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Snowridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Penryn</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G5</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G4</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Opteron_G1</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Nehalem</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Rome</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Milan</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Dhyana</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cooperlake</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Conroe</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>486</model>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:   </cpu>
Nov 10 11:46:37 user nova-compute[74889]:   <memoryBacking supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='sourceType'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>file</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>anonymous</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>memfd</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:   </memoryBacking>
Nov 10 11:46:37 user nova-compute[74889]:   <devices>
Nov 10 11:46:37 user nova-compute[74889]:     <disk supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='diskDevice'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>disk</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cdrom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>floppy</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>lun</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='bus'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>fdc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sata</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </disk>
Nov 10 11:46:37 user nova-compute[74889]:     <graphics supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sdl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vnc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>spice</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egl-headless</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </graphics>
Nov 10 11:46:37 user nova-compute[74889]:     <video supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='modelType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cirrus</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vmvga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>qxl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>none</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>bochs</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ramfb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </video>
Nov 10 11:46:37 user nova-compute[74889]:     <hostdev supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='mode'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>subsystem</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='startupPolicy'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>default</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>mandatory</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>requisite</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>optional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='subsysType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pci</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='capsType'/>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='pciBackend'/>
Nov 10 11:46:37 user nova-compute[74889]:     </hostdev>
Nov 10 11:46:37 user nova-compute[74889]:     <rng supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>random</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egd</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>builtin</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </rng>
Nov 10 11:46:37 user nova-compute[74889]:     <filesystem supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='driverType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>path</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>handle</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtiofs</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </filesystem>
Nov 10 11:46:37 user nova-compute[74889]:     <tpm supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-tis</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-crb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>passthrough</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>emulator</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </tpm>
Nov 10 11:46:37 user nova-compute[74889]:   </devices>
Nov 10 11:46:37 user nova-compute[74889]:   <features>
Nov 10 11:46:37 user nova-compute[74889]:     <gic supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     <vmcoreinfo supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <genid supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backingStoreInput supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backup supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <sev supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:   </features>
Nov 10 11:46:37 user nova-compute[74889]: </domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:  {{(pid=74889) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 10 11:46:37 user nova-compute[74889]: <domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 11:46:37 user nova-compute[74889]:   <domain>kvm</domain>
Nov 10 11:46:37 user nova-compute[74889]:   <machine>pc-i440fx-jammy</machine>
Nov 10 11:46:37 user nova-compute[74889]:   <arch>x86_64</arch>
Nov 10 11:46:37 user nova-compute[74889]:   <vcpu max='255'/>
Nov 10 11:46:37 user nova-compute[74889]:   <iothreads supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:   <os supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='firmware'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>efi</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:     <loader supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>rom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pflash</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='readonly'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>yes</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='secure'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>no</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </loader>
Nov 10 11:46:37 user nova-compute[74889]:   </os>
Nov 10 11:46:37 user nova-compute[74889]:   <cpu>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-passthrough' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='hostPassthroughMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='maximum' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='maximumMigratable'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>on</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>off</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='host-model' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <vendor>Intel</vendor>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ss'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='vmx'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pcid'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='hypervisor'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arat'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='umip'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='md-clear'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='invtsc'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibpb'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='ibrs'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-stibp'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='rsba'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='erms'/>
Nov 10 11:46:37 user nova-compute[74889]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:     <mode name='custom' supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>qemu64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>qemu32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>phenom</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>pentium</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>n270</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm64</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>kvm32</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>coreduo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>core2duo</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>athlon</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Westmere</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Snowridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Skylake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>SandyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Penryn</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G5</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G4</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G3</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Opteron_G2</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Opteron_G1</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Nehalem</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>IvyBridge</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Icelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Haswell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Rome</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-Milan</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>EPYC</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Dhyana</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cooperlake</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>Conroe</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='no'>Broadwell</model>
Nov 10 11:46:37 user nova-compute[74889]:       <model usable='yes'>486</model>
Nov 10 11:46:37 user nova-compute[74889]:     </mode>
Nov 10 11:46:37 user nova-compute[74889]:   </cpu>
Nov 10 11:46:37 user nova-compute[74889]:   <memoryBacking supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:     <enum name='sourceType'>
Nov 10 11:46:37 user nova-compute[74889]:       <value>file</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>anonymous</value>
Nov 10 11:46:37 user nova-compute[74889]:       <value>memfd</value>
Nov 10 11:46:37 user nova-compute[74889]:     </enum>
Nov 10 11:46:37 user nova-compute[74889]:   </memoryBacking>
Nov 10 11:46:37 user nova-compute[74889]:   <devices>
Nov 10 11:46:37 user nova-compute[74889]:     <disk supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='diskDevice'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>disk</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cdrom</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>floppy</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>lun</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='bus'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ide</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>fdc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sata</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </disk>
Nov 10 11:46:37 user nova-compute[74889]:     <graphics supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='type'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>sdl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vnc</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>spice</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egl-headless</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </graphics>
Nov 10 11:46:37 user nova-compute[74889]:     <video supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='modelType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>cirrus</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>vmvga</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>qxl</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>none</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>bochs</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>ramfb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </video>
Nov 10 11:46:37 user nova-compute[74889]:     <hostdev supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='mode'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>subsystem</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='startupPolicy'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>default</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>mandatory</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>requisite</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>optional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='subsysType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>usb</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>pci</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>scsi</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='capsType'/>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='pciBackend'/>
Nov 10 11:46:37 user nova-compute[74889]:     </hostdev>
Nov 10 11:46:37 user nova-compute[74889]:     <rng supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtio-non-transitional</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>random</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>egd</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>builtin</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </rng>
Nov 10 11:46:37 user nova-compute[74889]:     <filesystem supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='driverType'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>path</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>handle</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>virtiofs</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </filesystem>
Nov 10 11:46:37 user nova-compute[74889]:     <tpm supported='yes'>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='model'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-tis</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>tpm-crb</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:       <enum name='backendModel'>
Nov 10 11:46:37 user nova-compute[74889]:         <value>passthrough</value>
Nov 10 11:46:37 user nova-compute[74889]:         <value>emulator</value>
Nov 10 11:46:37 user nova-compute[74889]:       </enum>
Nov 10 11:46:37 user nova-compute[74889]:     </tpm>
Nov 10 11:46:37 user nova-compute[74889]:   </devices>
Nov 10 11:46:37 user nova-compute[74889]:   <features>
Nov 10 11:46:37 user nova-compute[74889]:     <gic supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:     <vmcoreinfo supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <genid supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backingStoreInput supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <backup supported='yes'/>
Nov 10 11:46:37 user nova-compute[74889]:     <sev supported='no'/>
Nov 10 11:46:37 user nova-compute[74889]:   </features>
Nov 10 11:46:37 user nova-compute[74889]: </domainCapabilities>
Nov 10 11:46:37 user nova-compute[74889]:  {{(pid=74889) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74889) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74889) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Checking secure boot support for host arch (x86_64) {{(pid=74889) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 11:46:37 user nova-compute[74889]: INFO nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Secure Boot support detected
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] cpu compare xml: <cpu match="exact">
Nov 10 11:46:37 user nova-compute[74889]:   <model>Nehalem</model>
Nov 10 11:46:37 user nova-compute[74889]: </cpu>
Nov 10 11:46:37 user nova-compute[74889]:  {{(pid=74889) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 10 11:46:37 user nova-compute[74889]: INFO nova.virt.node [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Generated node identity 07c73308-5a33-4ed2-81ea-818734657bdc
Nov 10 11:46:37 user nova-compute[74889]: INFO nova.virt.node [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Wrote node identity 07c73308-5a33-4ed2-81ea-818734657bdc to /opt/stack/data/nova/compute_id
Nov 10 11:46:37 user nova-compute[74889]: WARNING nova.compute.manager [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Compute nodes ['07c73308-5a33-4ed2-81ea-818734657bdc'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 10 11:46:37 user nova-compute[74889]: INFO nova.compute.manager [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 10 11:46:37 user nova-compute[74889]: WARNING nova.compute.manager [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 11:46:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:46:37 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:46:37 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Hypervisor/Node resource view: name=user free_ram=11004MB free_disk=26.271373748779297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:46:37 user nova-compute[74889]: WARNING nova.compute.resource_tracker [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] No compute node record for user:07c73308-5a33-4ed2-81ea-818734657bdc: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 07c73308-5a33-4ed2-81ea-818734657bdc could not be found.
Nov 10 11:46:37 user nova-compute[74889]: INFO nova.compute.resource_tracker [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Compute node record created for user:user with uuid: 07c73308-5a33-4ed2-81ea-818734657bdc
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:46:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:46:38 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] [req-fee3e2d2-eda0-4ac3-845b-738d3d25561d] Created resource provider record via placement API for resource provider with UUID 07c73308-5a33-4ed2-81ea-818734657bdc and name user.
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74889) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 10 11:46:38 user nova-compute[74889]: INFO nova.virt.libvirt.host [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] kernel doesn't support AMD SEV
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Libvirt baseline CPU <cpu>
Nov 10 11:46:38 user nova-compute[74889]:   <arch>x86_64</arch>
Nov 10 11:46:38 user nova-compute[74889]:   <model>Nehalem</model>
Nov 10 11:46:38 user nova-compute[74889]:   <vendor>Intel</vendor>
Nov 10 11:46:38 user nova-compute[74889]:   <topology sockets="6" cores="1" threads="1"/>
Nov 10 11:46:38 user nova-compute[74889]: </cpu>
Nov 10 11:46:38 user nova-compute[74889]:  {{(pid=74889) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Updated inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Updating resource provider 07c73308-5a33-4ed2-81ea-818734657bdc generation from 0 to 1 during operation: update_inventory {{(pid=74889) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Updating resource provider 07c73308-5a33-4ed2-81ea-818734657bdc generation from 1 to 2 during operation: update_traits {{(pid=74889) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.service [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Creating RPC server for service compute {{(pid=74889) start /opt/stack/nova/nova/service.py:182}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.service [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] Join ServiceGroup membership for this service compute {{(pid=74889) start /opt/stack/nova/nova/service.py:199}}
Nov 10 11:46:38 user nova-compute[74889]: DEBUG nova.servicegroup.drivers.db [None req-6d2f2bc3-3639-46b8-97ed-55eebae38fb0 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74889) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 10 11:47:15 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:15 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:47:29 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:47:29 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=10449MB free_disk=26.17519760131836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:47:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:48:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:48:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:48:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:48:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:48:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:48:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:48:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:48:30 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:48:30 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:48:30 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=10352MB free_disk=26.239479064941406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:48:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:48:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:48:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:48:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:48:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:49:29 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:49:29 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:49:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=10340MB free_disk=25.992069244384766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:49:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:49:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:49:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:49:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:49:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:49:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:49:32 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:49:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:49:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 11:49:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 11:49:32 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:49:32 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:49:33 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:50:29 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:50:29 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:50:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=9633MB free_disk=26.019744873046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:50:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:32 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:32 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:32 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:32 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:50:33 user nova-compute[74889]: INFO nova.compute.claims [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Claim successful on node user
Nov 10 11:50:34 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:50:34 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:50:34 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:50:34 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Creating image(s)
Nov 10 11:50:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "/opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "/opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "/opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:35 user nova-compute[74889]: DEBUG nova.policy [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89dc402d78ab447f86cce065422fb9cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51bcafc15ed24037a90c2e9dc1c645e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:50:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a.part --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:35 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:50:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a.part --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:35 user nova-compute[74889]: DEBUG nova.virt.images [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] b0074759-91cd-4b7c-8386-071a17ff617a was qcow2, converting to raw {{(pid=74889) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 11:50:35 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 11:50:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a.part /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a.converted {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a.part /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a.converted" returned: 0 in 0.207s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a.converted --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.325s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:36 user nova-compute[74889]: INFO oslo.privsep.daemon [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi6fhagxz/privsep.sock']
Nov 10 11:50:36 user sudo[84122]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi6fhagxz/privsep.sock
Nov 10 11:50:36 user sudo[84122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 11:50:37 user sudo[84122]: pam_unix(sudo:session): session closed for user root
Nov 10 11:50:37 user nova-compute[74889]: INFO oslo.privsep.daemon [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Spawned new privsep daemon via rootwrap
Nov 10 11:50:37 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 11:50:37 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 11:50:37 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 10 11:50:37 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84125
Nov 10 11:50:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Successfully created port: e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.227s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk 1073741824" returned: 0 in 0.048s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Cannot resize image /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Ensure instance console log exists: /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:50:38 user nova-compute[74889]: INFO nova.compute.claims [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Claim successful on node user
Nov 10 11:50:38 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:50:38 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:50:39 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:50:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG nova.policy [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dd24986fbd2446dbb8f5fbc7edb1757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeabeb4c529647f296feb83801c04f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:50:39 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Creating image(s)
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "/opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "/opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "/opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "19d4137a-5cdf-42d1-8846-35813d6360f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk 1073741824" returned: 0 in 0.045s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:50:39 user nova-compute[74889]: INFO nova.compute.claims [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Claim successful on node user
Nov 10 11:50:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Successfully updated port: e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.193s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "refresh_cache-03f62fe3-a6ce-45bc-a99a-4d134b330c1e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquired lock "refresh_cache-03f62fe3-a6ce-45bc-a99a-4d134b330c1e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Cannot resize image /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Ensure instance console log exists: /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-ae853368-05e0-4964-91c3-689c2fb5c419 req-004776bb-2d2f-4791-bcbc-191108c12f08 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received event network-changed-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-ae853368-05e0-4964-91c3-689c2fb5c419 req-004776bb-2d2f-4791-bcbc-191108c12f08 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Refreshing instance network info cache due to event network-changed-e65d5e17-91a1-467d-a9bf-b7e38ca34af4. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ae853368-05e0-4964-91c3-689c2fb5c419 req-004776bb-2d2f-4791-bcbc-191108c12f08 service nova] Acquiring lock "refresh_cache-03f62fe3-a6ce-45bc-a99a-4d134b330c1e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Updating instance_info_cache with network_info: [{"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:50:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Releasing lock "refresh_cache-03f62fe3-a6ce-45bc-a99a-4d134b330c1e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Instance network_info: |[{"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ae853368-05e0-4964-91c3-689c2fb5c419 req-004776bb-2d2f-4791-bcbc-191108c12f08 service nova] Acquired lock "refresh_cache-03f62fe3-a6ce-45bc-a99a-4d134b330c1e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.network.neutron [req-ae853368-05e0-4964-91c3-689c2fb5c419 req-004776bb-2d2f-4791-bcbc-191108c12f08 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Refreshing network info cache for port e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Start _get_guest_xml network_info=[{"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:50:40 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:50:40 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-333454560',display_name='tempest-DeleteServersTestJSON-server-333454560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-333454560',id=1,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51bcafc15ed24037a90c2e9dc1c645e6',ramdisk_id='',reservation_id='r-nfbpgucr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-961605254',owner_user_name='tempest-DeleteServersTestJSON-961605254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:50:35Z,user_data=None,user_id='89dc402d78ab447f86cce065422fb9cb',uuid=03f62fe3-a6ce-45bc-a99a-4d134b330c1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Converting VIF {"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:04:5b,bridge_name='br-int',has_traffic_filtering=True,id=e65d5e17-91a1-467d-a9bf-b7e38ca34af4,network=Network(a5e8d5fc-2b28-4618-b64e-1d56ca67367f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65d5e17-91') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.objects.instance [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f62fe3-a6ce-45bc-a99a-4d134b330c1e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.policy [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f4638ca003c46dab10aab2e5a2e6fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688cad5e5288440bb533d6e2c2f764c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:50:40 user nova-compute[74889]:   <uuid>03f62fe3-a6ce-45bc-a99a-4d134b330c1e</uuid>
Nov 10 11:50:40 user nova-compute[74889]:   <name>instance-00000001</name>
Nov 10 11:50:40 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:50:40 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:50:40 user nova-compute[74889]:   <metadata>
Nov 10 11:50:40 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:50:40 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:50:40 user nova-compute[74889]:       <nova:name>tempest-DeleteServersTestJSON-server-333454560</nova:name>
Nov 10 11:50:40 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:50:40</nova:creationTime>
Nov 10 11:50:40 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:50:40 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:50:40 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:50:40 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:50:40 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:50:40 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:50:40 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:50:40 user nova-compute[74889]:       <nova:owner>
Nov 10 11:50:40 user nova-compute[74889]:         <nova:user uuid="89dc402d78ab447f86cce065422fb9cb">tempest-DeleteServersTestJSON-961605254-project-member</nova:user>
Nov 10 11:50:40 user nova-compute[74889]:         <nova:project uuid="51bcafc15ed24037a90c2e9dc1c645e6">tempest-DeleteServersTestJSON-961605254</nova:project>
Nov 10 11:50:40 user nova-compute[74889]:       </nova:owner>
Nov 10 11:50:40 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:50:40 user nova-compute[74889]:       <nova:ports>
Nov 10 11:50:40 user nova-compute[74889]:         <nova:port uuid="e65d5e17-91a1-467d-a9bf-b7e38ca34af4">
Nov 10 11:50:40 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 11:50:40 user nova-compute[74889]:         </nova:port>
Nov 10 11:50:40 user nova-compute[74889]:       </nova:ports>
Nov 10 11:50:40 user nova-compute[74889]:     </nova:instance>
Nov 10 11:50:40 user nova-compute[74889]:   </metadata>
Nov 10 11:50:40 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:50:40 user nova-compute[74889]:     <system>
Nov 10 11:50:40 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:50:40 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:50:40 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:50:40 user nova-compute[74889]:       <entry name="serial">03f62fe3-a6ce-45bc-a99a-4d134b330c1e</entry>
Nov 10 11:50:40 user nova-compute[74889]:       <entry name="uuid">03f62fe3-a6ce-45bc-a99a-4d134b330c1e</entry>
Nov 10 11:50:40 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:50:40 user nova-compute[74889]:     </system>
Nov 10 11:50:40 user nova-compute[74889]:   </sysinfo>
Nov 10 11:50:40 user nova-compute[74889]:   <os>
Nov 10 11:50:40 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:50:40 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:50:40 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:50:40 user nova-compute[74889]:   </os>
Nov 10 11:50:40 user nova-compute[74889]:   <features>
Nov 10 11:50:40 user nova-compute[74889]:     <acpi/>
Nov 10 11:50:40 user nova-compute[74889]:     <apic/>
Nov 10 11:50:40 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:50:40 user nova-compute[74889]:   </features>
Nov 10 11:50:40 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:50:40 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:50:40 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:50:40 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:50:40 user nova-compute[74889]:   </clock>
Nov 10 11:50:40 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:50:40 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:50:40 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:50:40 user nova-compute[74889]:   </cpu>
Nov 10 11:50:40 user nova-compute[74889]:   <devices>
Nov 10 11:50:40 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:50:40 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:50:40 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk"/>
Nov 10 11:50:40 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:50:40 user nova-compute[74889]:     </disk>
Nov 10 11:50:40 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:50:40 user nova-compute[74889]:       <mac address="fa:16:3e:bc:04:5b"/>
Nov 10 11:50:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:50:40 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:50:40 user nova-compute[74889]:       <target dev="tape65d5e17-91"/>
Nov 10 11:50:40 user nova-compute[74889]:     </interface>
Nov 10 11:50:40 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:50:40 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/console.log" append="off"/>
Nov 10 11:50:40 user nova-compute[74889]:     </serial>
Nov 10 11:50:40 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:50:40 user nova-compute[74889]:     <video>
Nov 10 11:50:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:50:40 user nova-compute[74889]:     </video>
Nov 10 11:50:40 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:50:40 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:50:40 user nova-compute[74889]:     </rng>
Nov 10 11:50:40 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:50:40 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:50:40 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:50:40 user nova-compute[74889]:     </memballoon>
Nov 10 11:50:40 user nova-compute[74889]:   </devices>
Nov 10 11:50:40 user nova-compute[74889]: </domain>
Nov 10 11:50:40 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-333454560',display_name='tempest-DeleteServersTestJSON-server-333454560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-333454560',id=1,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51bcafc15ed24037a90c2e9dc1c645e6',ramdisk_id='',reservation_id='r-nfbpgucr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-961605254',owner_user_name='tempest-DeleteServersTestJSON-961605254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:50:35Z,user_data=None,user_id='89dc402d78ab447f86cce065422fb9cb',uuid=03f62fe3-a6ce-45bc-a99a-4d134b330c1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Converting VIF {"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:04:5b,bridge_name='br-int',has_traffic_filtering=True,id=e65d5e17-91a1-467d-a9bf-b7e38ca34af4,network=Network(a5e8d5fc-2b28-4618-b64e-1d56ca67367f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65d5e17-91') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG os_vif [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:04:5b,bridge_name='br-int',has_traffic_filtering=True,id=e65d5e17-91a1-467d-a9bf-b7e38ca34af4,network=Network(a5e8d5fc-2b28-4618-b64e-1d56ca67367f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65d5e17-91') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Created schema index Interface.name {{(pid=74889) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Created schema index Port.name {{(pid=74889) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Created schema index Bridge.name {{(pid=74889) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [POLLOUT] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:50:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Creating image(s)
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "/opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "/opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "/opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '891a34b8-d9f2-57e0-8124-a8934ce3e846', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:50:41 user nova-compute[74889]: INFO oslo.privsep.daemon [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpa2dw9_3r/privsep.sock']
Nov 10 11:50:41 user sudo[84173]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpa2dw9_3r/privsep.sock
Nov 10 11:50:41 user sudo[84173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk 1073741824" returned: 0 in 0.042s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG nova.network.neutron [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Successfully created port: 5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.154s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-ae853368-05e0-4964-91c3-689c2fb5c419 req-004776bb-2d2f-4791-bcbc-191108c12f08 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Updated VIF entry in instance network info cache for port e65d5e17-91a1-467d-a9bf-b7e38ca34af4. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-ae853368-05e0-4964-91c3-689c2fb5c419 req-004776bb-2d2f-4791-bcbc-191108c12f08 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Updating instance_info_cache with network_info: [{"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ae853368-05e0-4964-91c3-689c2fb5c419 req-004776bb-2d2f-4791-bcbc-191108c12f08 service nova] Releasing lock "refresh_cache-03f62fe3-a6ce-45bc-a99a-4d134b330c1e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Cannot resize image /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Ensure instance console log exists: /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:41 user nova-compute[74889]: DEBUG nova.network.neutron [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Successfully created port: 02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:50:42 user sudo[84173]: pam_unix(sudo:session): session closed for user root
Nov 10 11:50:42 user nova-compute[74889]: INFO oslo.privsep.daemon [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Spawned new privsep daemon via rootwrap
Nov 10 11:50:42 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 11:50:42 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 11:50:42 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 10 11:50:42 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84212
Nov 10 11:50:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape65d5e17-91, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape65d5e17-91, col_values=(('qos', UUID('5f0eed2c-3299-4850-a2ba-c11eb42b5785')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape65d5e17-91, col_values=(('external_ids', {'iface-id': 'e65d5e17-91a1-467d-a9bf-b7e38ca34af4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:04:5b', 'vm-uuid': '03f62fe3-a6ce-45bc-a99a-4d134b330c1e'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:43 user nova-compute[74889]: INFO os_vif [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:04:5b,bridge_name='br-int',has_traffic_filtering=True,id=e65d5e17-91a1-467d-a9bf-b7e38ca34af4,network=Network(a5e8d5fc-2b28-4618-b64e-1d56ca67367f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65d5e17-91')
Nov 10 11:50:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Successfully updated port: 02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] No VIF found with MAC fa:16:3e:bc:04:5b, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquired lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Successfully updated port: 5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquired lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-c2edd497-0df2-45c2-8f07-d101d01f8d3c req-f3874aa2-eb6c-41af-8742-36723817ec78 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received event network-changed-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-c2edd497-0df2-45c2-8f07-d101d01f8d3c req-f3874aa2-eb6c-41af-8742-36723817ec78 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Refreshing instance network info cache due to event network-changed-02539ac7-b338-4419-8c36-f8683da00cb5. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c2edd497-0df2-45c2-8f07-d101d01f8d3c req-f3874aa2-eb6c-41af-8742-36723817ec78 service nova] Acquiring lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:50:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-2c04104f-4642-486f-a2ec-4bead2914c61 req-e1139dc5-0c07-4ff0-9881-f1dcb38c3a93 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-changed-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-2c04104f-4642-486f-a2ec-4bead2914c61 req-e1139dc5-0c07-4ff0-9881-f1dcb38c3a93 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Refreshing instance network info cache due to event network-changed-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2c04104f-4642-486f-a2ec-4bead2914c61 req-e1139dc5-0c07-4ff0-9881-f1dcb38c3a93 service nova] Acquiring lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updating instance_info_cache with network_info: [{"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Releasing lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Instance network_info: |[{"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c2edd497-0df2-45c2-8f07-d101d01f8d3c req-f3874aa2-eb6c-41af-8742-36723817ec78 service nova] Acquired lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.network.neutron [req-c2edd497-0df2-45c2-8f07-d101d01f8d3c req-f3874aa2-eb6c-41af-8742-36723817ec78 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Refreshing network info cache for port 02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Start _get_guest_xml network_info=[{"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:50:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:50:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-24504662',display_name='tempest-ServerActionsTestOtherA-server-24504662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-24504662',id=3,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV2sPROd86lDqNq7yn/OdL+EAGi3OrNcdrVAdLzqRGaXMCeQRt25LrQ3Ql1TrND/6Dz6MBX7QNwi3U9n4Q2xTxIhGV3gbETVuDolUvGcK3ZVpcr8zuoJBqyHEchy/q4SQ==',key_name='tempest-keypair-943743287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-tnggw9ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=19d4137a-5cdf-42d1-8846-35813d6360f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:dd,bridge_name='br-int',has_traffic_filtering=True,id=02539ac7-b338-4419-8c36-f8683da00cb5,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02539ac7-b3') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.objects.instance [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'pci_devices' on Instance uuid 19d4137a-5cdf-42d1-8846-35813d6360f6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:50:44 user nova-compute[74889]:   <uuid>19d4137a-5cdf-42d1-8846-35813d6360f6</uuid>
Nov 10 11:50:44 user nova-compute[74889]:   <name>instance-00000003</name>
Nov 10 11:50:44 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:50:44 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:50:44 user nova-compute[74889]:   <metadata>
Nov 10 11:50:44 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:50:44 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:50:44 user nova-compute[74889]:       <nova:name>tempest-ServerActionsTestOtherA-server-24504662</nova:name>
Nov 10 11:50:44 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:50:44</nova:creationTime>
Nov 10 11:50:44 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:50:44 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:50:44 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:50:44 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:50:44 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:50:44 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:50:44 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:50:44 user nova-compute[74889]:       <nova:owner>
Nov 10 11:50:44 user nova-compute[74889]:         <nova:user uuid="8f4638ca003c46dab10aab2e5a2e6fb4">tempest-ServerActionsTestOtherA-631643283-project-member</nova:user>
Nov 10 11:50:44 user nova-compute[74889]:         <nova:project uuid="688cad5e5288440bb533d6e2c2f764c1">tempest-ServerActionsTestOtherA-631643283</nova:project>
Nov 10 11:50:44 user nova-compute[74889]:       </nova:owner>
Nov 10 11:50:44 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:50:44 user nova-compute[74889]:       <nova:ports>
Nov 10 11:50:44 user nova-compute[74889]:         <nova:port uuid="02539ac7-b338-4419-8c36-f8683da00cb5">
Nov 10 11:50:44 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 11:50:44 user nova-compute[74889]:         </nova:port>
Nov 10 11:50:44 user nova-compute[74889]:       </nova:ports>
Nov 10 11:50:44 user nova-compute[74889]:     </nova:instance>
Nov 10 11:50:44 user nova-compute[74889]:   </metadata>
Nov 10 11:50:44 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:50:44 user nova-compute[74889]:     <system>
Nov 10 11:50:44 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:50:44 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:50:44 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:50:44 user nova-compute[74889]:       <entry name="serial">19d4137a-5cdf-42d1-8846-35813d6360f6</entry>
Nov 10 11:50:44 user nova-compute[74889]:       <entry name="uuid">19d4137a-5cdf-42d1-8846-35813d6360f6</entry>
Nov 10 11:50:44 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:50:44 user nova-compute[74889]:     </system>
Nov 10 11:50:44 user nova-compute[74889]:   </sysinfo>
Nov 10 11:50:44 user nova-compute[74889]:   <os>
Nov 10 11:50:44 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:50:44 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:50:44 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:50:44 user nova-compute[74889]:   </os>
Nov 10 11:50:44 user nova-compute[74889]:   <features>
Nov 10 11:50:44 user nova-compute[74889]:     <acpi/>
Nov 10 11:50:44 user nova-compute[74889]:     <apic/>
Nov 10 11:50:44 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:50:44 user nova-compute[74889]:   </features>
Nov 10 11:50:44 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:50:44 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:50:44 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:50:44 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:50:44 user nova-compute[74889]:   </clock>
Nov 10 11:50:44 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:50:44 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:50:44 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:50:44 user nova-compute[74889]:   </cpu>
Nov 10 11:50:44 user nova-compute[74889]:   <devices>
Nov 10 11:50:44 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:50:44 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:50:44 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk"/>
Nov 10 11:50:44 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:50:44 user nova-compute[74889]:     </disk>
Nov 10 11:50:44 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:50:44 user nova-compute[74889]:       <mac address="fa:16:3e:cd:12:dd"/>
Nov 10 11:50:44 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:50:44 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:50:44 user nova-compute[74889]:       <target dev="tap02539ac7-b3"/>
Nov 10 11:50:44 user nova-compute[74889]:     </interface>
Nov 10 11:50:44 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:50:44 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/console.log" append="off"/>
Nov 10 11:50:44 user nova-compute[74889]:     </serial>
Nov 10 11:50:44 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:50:44 user nova-compute[74889]:     <video>
Nov 10 11:50:44 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:50:44 user nova-compute[74889]:     </video>
Nov 10 11:50:44 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:50:44 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:50:44 user nova-compute[74889]:     </rng>
Nov 10 11:50:44 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:50:44 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:50:44 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:50:44 user nova-compute[74889]:     </memballoon>
Nov 10 11:50:44 user nova-compute[74889]:   </devices>
Nov 10 11:50:44 user nova-compute[74889]: </domain>
Nov 10 11:50:44 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-24504662',display_name='tempest-ServerActionsTestOtherA-server-24504662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-24504662',id=3,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV2sPROd86lDqNq7yn/OdL+EAGi3OrNcdrVAdLzqRGaXMCeQRt25LrQ3Ql1TrND/6Dz6MBX7QNwi3U9n4Q2xTxIhGV3gbETVuDolUvGcK3ZVpcr8zuoJBqyHEchy/q4SQ==',key_name='tempest-keypair-943743287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-tnggw9ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:50:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=19d4137a-5cdf-42d1-8846-35813d6360f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:dd,bridge_name='br-int',has_traffic_filtering=True,id=02539ac7-b338-4419-8c36-f8683da00cb5,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02539ac7-b3') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG os_vif [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:dd,bridge_name='br-int',has_traffic_filtering=True,id=02539ac7-b338-4419-8c36-f8683da00cb5,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02539ac7-b3') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd96407d-113b-528f-a4ac-33ccd9d547f4', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02539ac7-b3, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02539ac7-b3, col_values=(('qos', UUID('c111b159-faf3-4dfe-8390-8d1341fe7a34')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02539ac7-b3, col_values=(('external_ids', {'iface-id': '02539ac7-b338-4419-8c36-f8683da00cb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:12:dd', 'vm-uuid': '19d4137a-5cdf-42d1-8846-35813d6360f6'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:44 user nova-compute[74889]: INFO os_vif [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:12:dd,bridge_name='br-int',has_traffic_filtering=True,id=02539ac7-b338-4419-8c36-f8683da00cb5,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02539ac7-b3')
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No VIF found with MAC fa:16:3e:cd:12:dd, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.network.neutron [req-c2edd497-0df2-45c2-8f07-d101d01f8d3c req-f3874aa2-eb6c-41af-8742-36723817ec78 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updated VIF entry in instance network info cache for port 02539ac7-b338-4419-8c36-f8683da00cb5. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG nova.network.neutron [req-c2edd497-0df2-45c2-8f07-d101d01f8d3c req-f3874aa2-eb6c-41af-8742-36723817ec78 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updating instance_info_cache with network_info: [{"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c2edd497-0df2-45c2-8f07-d101d01f8d3c req-f3874aa2-eb6c-41af-8742-36723817ec78 service nova] Releasing lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:50:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.network.neutron [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updating instance_info_cache with network_info: [{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Releasing lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance network_info: |[{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2c04104f-4642-486f-a2ec-4bead2914c61 req-e1139dc5-0c07-4ff0-9881-f1dcb38c3a93 service nova] Acquired lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.network.neutron [req-2c04104f-4642-486f-a2ec-4bead2914c61 req-e1139dc5-0c07-4ff0-9881-f1dcb38c3a93 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Refreshing network info cache for port 5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Start _get_guest_xml network_info=[{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:50:45 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-518100689',display_name='tempest-AttachVolumeTestJSON-server-518100689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-518100689',id=2,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEh76cZ/xflXBEdMOROgxqbhG35Jz0cqE4YYKJiGcf50O8aLCm2o2DfUHmGwzHJW0DU1jZ0rVUpQW2CmcsWOI30JbHZMThJB6IQjvv8CUUQ6Nrn1BLEBG5jDbyobMxuOg==',key_name='tempest-keypair-1235958409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-ngy0se22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=527ef5ba-c67a-481a-b835-e8b6196f3902,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.objects.instance [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'pci_devices' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:50:45 user nova-compute[74889]:   <uuid>527ef5ba-c67a-481a-b835-e8b6196f3902</uuid>
Nov 10 11:50:45 user nova-compute[74889]:   <name>instance-00000002</name>
Nov 10 11:50:45 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:50:45 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:50:45 user nova-compute[74889]:   <metadata>
Nov 10 11:50:45 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:50:45 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:50:45 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeTestJSON-server-518100689</nova:name>
Nov 10 11:50:45 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:50:45</nova:creationTime>
Nov 10 11:50:45 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:50:45 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:50:45 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:50:45 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:50:45 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:50:45 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:50:45 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:50:45 user nova-compute[74889]:       <nova:owner>
Nov 10 11:50:45 user nova-compute[74889]:         <nova:user uuid="9dd24986fbd2446dbb8f5fbc7edb1757">tempest-AttachVolumeTestJSON-1611590837-project-member</nova:user>
Nov 10 11:50:45 user nova-compute[74889]:         <nova:project uuid="eeabeb4c529647f296feb83801c04f34">tempest-AttachVolumeTestJSON-1611590837</nova:project>
Nov 10 11:50:45 user nova-compute[74889]:       </nova:owner>
Nov 10 11:50:45 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:50:45 user nova-compute[74889]:       <nova:ports>
Nov 10 11:50:45 user nova-compute[74889]:         <nova:port uuid="5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50">
Nov 10 11:50:45 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 11:50:45 user nova-compute[74889]:         </nova:port>
Nov 10 11:50:45 user nova-compute[74889]:       </nova:ports>
Nov 10 11:50:45 user nova-compute[74889]:     </nova:instance>
Nov 10 11:50:45 user nova-compute[74889]:   </metadata>
Nov 10 11:50:45 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:50:45 user nova-compute[74889]:     <system>
Nov 10 11:50:45 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:50:45 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:50:45 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:50:45 user nova-compute[74889]:       <entry name="serial">527ef5ba-c67a-481a-b835-e8b6196f3902</entry>
Nov 10 11:50:45 user nova-compute[74889]:       <entry name="uuid">527ef5ba-c67a-481a-b835-e8b6196f3902</entry>
Nov 10 11:50:45 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:50:45 user nova-compute[74889]:     </system>
Nov 10 11:50:45 user nova-compute[74889]:   </sysinfo>
Nov 10 11:50:45 user nova-compute[74889]:   <os>
Nov 10 11:50:45 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:50:45 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:50:45 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:50:45 user nova-compute[74889]:   </os>
Nov 10 11:50:45 user nova-compute[74889]:   <features>
Nov 10 11:50:45 user nova-compute[74889]:     <acpi/>
Nov 10 11:50:45 user nova-compute[74889]:     <apic/>
Nov 10 11:50:45 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:50:45 user nova-compute[74889]:   </features>
Nov 10 11:50:45 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:50:45 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:50:45 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:50:45 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:50:45 user nova-compute[74889]:   </clock>
Nov 10 11:50:45 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:50:45 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:50:45 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:50:45 user nova-compute[74889]:   </cpu>
Nov 10 11:50:45 user nova-compute[74889]:   <devices>
Nov 10 11:50:45 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:50:45 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:50:45 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk"/>
Nov 10 11:50:45 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:50:45 user nova-compute[74889]:     </disk>
Nov 10 11:50:45 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:50:45 user nova-compute[74889]:       <mac address="fa:16:3e:84:97:e7"/>
Nov 10 11:50:45 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:50:45 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:50:45 user nova-compute[74889]:       <target dev="tap5b2c7fdc-3f"/>
Nov 10 11:50:45 user nova-compute[74889]:     </interface>
Nov 10 11:50:45 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:50:45 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/console.log" append="off"/>
Nov 10 11:50:45 user nova-compute[74889]:     </serial>
Nov 10 11:50:45 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:50:45 user nova-compute[74889]:     <video>
Nov 10 11:50:45 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:50:45 user nova-compute[74889]:     </video>
Nov 10 11:50:45 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:50:45 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:50:45 user nova-compute[74889]:     </rng>
Nov 10 11:50:45 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:50:45 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:50:45 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:50:45 user nova-compute[74889]:     </memballoon>
Nov 10 11:50:45 user nova-compute[74889]:   </devices>
Nov 10 11:50:45 user nova-compute[74889]: </domain>
Nov 10 11:50:45 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-518100689',display_name='tempest-AttachVolumeTestJSON-server-518100689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-518100689',id=2,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEh76cZ/xflXBEdMOROgxqbhG35Jz0cqE4YYKJiGcf50O8aLCm2o2DfUHmGwzHJW0DU1jZ0rVUpQW2CmcsWOI30JbHZMThJB6IQjvv8CUUQ6Nrn1BLEBG5jDbyobMxuOg==',key_name='tempest-keypair-1235958409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-ngy0se22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=527ef5ba-c67a-481a-b835-e8b6196f3902,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG os_vif [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7ce74a7-78d6-5377-b2df-ef36d135d0bf', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b2c7fdc-3f, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b2c7fdc-3f, col_values=(('qos', UUID('31cbdc5a-5324-45ac-a55a-c57725be1496')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b2c7fdc-3f, col_values=(('external_ids', {'iface-id': '5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:97:e7', 'vm-uuid': '527ef5ba-c67a-481a-b835-e8b6196f3902'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:45 user nova-compute[74889]: INFO os_vif [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f')
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:50:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No VIF found with MAC fa:16:3e:84:97:e7, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:50:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-2c04104f-4642-486f-a2ec-4bead2914c61 req-e1139dc5-0c07-4ff0-9881-f1dcb38c3a93 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updated VIF entry in instance network info cache for port 5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:50:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-2c04104f-4642-486f-a2ec-4bead2914c61 req-e1139dc5-0c07-4ff0-9881-f1dcb38c3a93 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updating instance_info_cache with network_info: [{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:50:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2c04104f-4642-486f-a2ec-4bead2914c61 req-e1139dc5-0c07-4ff0-9881-f1dcb38c3a93 service nova] Releasing lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:50:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:50:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:50:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Instance spawned successfully.
Nov 10 11:50:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:50:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:49 user nova-compute[74889]: INFO nova.compute.manager [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Took 15.13 seconds to spawn the instance on the hypervisor.
Nov 10 11:50:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:50:50 user nova-compute[74889]: INFO nova.compute.manager [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Took 16.28 seconds to build instance.
Nov 10 11:50:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cce3a17d-949c-4202-a5d3-5d4eb0100d47 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.730s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-1e9065fb-797d-47a2-b2b3-71b8644a740c req-af7e0834-5ef7-4f30-a8a9-f80e9dfb8ba1 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received event network-vif-plugged-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:50:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1e9065fb-797d-47a2-b2b3-71b8644a740c req-af7e0834-5ef7-4f30-a8a9-f80e9dfb8ba1 service nova] Acquiring lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1e9065fb-797d-47a2-b2b3-71b8644a740c req-af7e0834-5ef7-4f30-a8a9-f80e9dfb8ba1 service nova] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1e9065fb-797d-47a2-b2b3-71b8644a740c req-af7e0834-5ef7-4f30-a8a9-f80e9dfb8ba1 service nova] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-1e9065fb-797d-47a2-b2b3-71b8644a740c req-af7e0834-5ef7-4f30-a8a9-f80e9dfb8ba1 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] No waiting events found dispatching network-vif-plugged-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:50:50 user nova-compute[74889]: WARNING nova.compute.manager [req-1e9065fb-797d-47a2-b2b3-71b8644a740c req-af7e0834-5ef7-4f30-a8a9-f80e9dfb8ba1 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received unexpected event network-vif-plugged-02539ac7-b338-4419-8c36-f8683da00cb5 for instance with vm_state building and task_state spawning.
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.compute.manager [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.compute.manager [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:50:51 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance spawned successfully.
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:50:51 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Instance spawned successfully.
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:50:51 user nova-compute[74889]: INFO nova.compute.manager [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Took 11.90 seconds to spawn the instance on the hypervisor.
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.compute.manager [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:50:51 user nova-compute[74889]: INFO nova.compute.manager [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Took 10.34 seconds to spawn the instance on the hypervisor.
Nov 10 11:50:51 user nova-compute[74889]: DEBUG nova.compute.manager [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:50:51 user nova-compute[74889]: INFO nova.compute.manager [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Took 12.76 seconds to build instance.
Nov 10 11:50:51 user nova-compute[74889]: INFO nova.compute.manager [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Took 11.54 seconds to build instance.
Nov 10 11:50:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a87806-0147-40d4-8490-a340cde24a42 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.915s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-94c25531-ad5f-41ba-91c4-e258b5800375 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.703s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-796d2b4d-7632-4afc-ba76-51bb03f55942 req-b0c4b484-5c5d-4227-a8c1-c941376b78ce service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received event network-vif-plugged-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:50:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-796d2b4d-7632-4afc-ba76-51bb03f55942 req-b0c4b484-5c5d-4227-a8c1-c941376b78ce service nova] Acquiring lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-796d2b4d-7632-4afc-ba76-51bb03f55942 req-b0c4b484-5c5d-4227-a8c1-c941376b78ce service nova] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-796d2b4d-7632-4afc-ba76-51bb03f55942 req-b0c4b484-5c5d-4227-a8c1-c941376b78ce service nova] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-796d2b4d-7632-4afc-ba76-51bb03f55942 req-b0c4b484-5c5d-4227-a8c1-c941376b78ce service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] No waiting events found dispatching network-vif-plugged-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:50:52 user nova-compute[74889]: WARNING nova.compute.manager [req-796d2b4d-7632-4afc-ba76-51bb03f55942 req-b0c4b484-5c5d-4227-a8c1-c941376b78ce service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received unexpected event network-vif-plugged-02539ac7-b338-4419-8c36-f8683da00cb5 for instance with vm_state active and task_state None.
Nov 10 11:50:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:50:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:50:55 user nova-compute[74889]: INFO nova.compute.claims [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Claim successful on node user
Nov 10 11:50:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:50:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 10 11:50:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG nova.policy [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8849d2da16fa406ba5db2b5995dfa172', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '869f808d49da47e2a1fd50043a85cd2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:50:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Creating image(s)
Nov 10 11:50:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "/opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "/opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "/opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "10776148a73a31b4f4592cc4b110815cb0a4de2c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "10776148a73a31b4f4592cc4b110815cb0a4de2c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c.part --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c.part --force-share --output=json" returned: 0 in 0.284s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:57 user nova-compute[74889]: DEBUG nova.virt.images [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] acf5b0a4-99b0-4569-b39f-e59bcd9383eb was qcow2, converting to raw {{(pid=74889) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 11:50:57 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 11:50:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c.part /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c.converted {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c.part /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c.converted" returned: 0 in 0.285s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c.converted --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c.converted --force-share --output=json" returned: 0 in 0.284s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "10776148a73a31b4f4592cc4b110815cb0a4de2c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.497s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG nova.network.neutron [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Successfully created port: 9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c --force-share --output=json" returned: 0 in 0.278s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "10776148a73a31b4f4592cc4b110815cb0a4de2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "10776148a73a31b4f4592cc4b110815cb0a4de2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c --force-share --output=json" returned: 0 in 0.290s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c,backing_fmt=raw /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c,backing_fmt=raw /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk 1073741824" returned: 0 in 0.060s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "10776148a73a31b4f4592cc4b110815cb0a4de2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c --force-share --output=json" returned: 0 in 0.306s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Checking if we can resize image /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Successfully updated port: 9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Cannot resize image /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Ensure instance console log exists: /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquired lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-52b3462d-b101-4162-bd90-fd861e48ee18 req-af8f4065-e1a2-4be7-965d-a8d35601cec2 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received event network-changed-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-52b3462d-b101-4162-bd90-fd861e48ee18 req-af8f4065-e1a2-4be7-965d-a8d35601cec2 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Refreshing instance network info cache due to event network-changed-9c692175-8e5b-4186-b654-169463411093. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-52b3462d-b101-4162-bd90-fd861e48ee18 req-af8f4065-e1a2-4be7-965d-a8d35601cec2 service nova] Acquiring lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Updating instance_info_cache with network_info: [{"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Releasing lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Instance network_info: |[{"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-52b3462d-b101-4162-bd90-fd861e48ee18 req-af8f4065-e1a2-4be7-965d-a8d35601cec2 service nova] Acquired lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.network.neutron [req-52b3462d-b101-4162-bd90-fd861e48ee18 req-af8f4065-e1a2-4be7-965d-a8d35601cec2 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Refreshing network info cache for port 9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Start _get_guest_xml network_info=[{"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:50:48Z,direct_url=<?>,disk_format='qcow2',id=acf5b0a4-99b0-4569-b39f-e59bcd9383eb,min_disk=0,min_ram=0,name='',owner='e53e5d4782cb4b8cab5fb49ea50f3c57',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:50:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'acf5b0a4-99b0-4569-b39f-e59bcd9383eb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:50:59 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:50:59 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:50:48Z,direct_url=<?>,disk_format='qcow2',id=acf5b0a4-99b0-4569-b39f-e59bcd9383eb,min_disk=0,min_ram=0,name='',owner='e53e5d4782cb4b8cab5fb49ea50f3c57',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:50:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-403710932',display_name='tempest-AttachSCSIVolumeTestJSON-server-403710932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-403710932',id=4,image_ref='acf5b0a4-99b0-4569-b39f-e59bcd9383eb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHM75RrC5nApOj2YPB9B1Mv5sVmRnmkVj66dQe/Vq4BKc9az1bySWoDRZ1+unImAEuSNnpM2nXi/O+WG8lAuO2qq3XO42vwk2lzLhWWafemNxWDFmbg6/RYinP5pWc8uHQ==',key_name='tempest-keypair-582329993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='869f808d49da47e2a1fd50043a85cd2d',ramdisk_id='',reservation_id='r-wqs415hp',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='acf5b0a4-99b0-4569-b39f-e59bcd9383eb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-254135104',owner_user_name='tempest-AttachSCSIVolumeTestJSON-254135104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8849d2da16fa406ba5db2b5995dfa172',uuid=133007ba-7922-43b9-babc-4e32bd0dcb1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Converting VIF {"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3d:42,bridge_name='br-int',has_traffic_filtering=True,id=9c692175-8e5b-4186-b654-169463411093,network=Network(c13ac228-5f2f-4683-90f7-df4d9313c9b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c692175-8e') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:50:59 user nova-compute[74889]: DEBUG nova.objects.instance [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lazy-loading 'pci_devices' on Instance uuid 133007ba-7922-43b9-babc-4e32bd0dcb1f {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:51:00 user nova-compute[74889]:   <uuid>133007ba-7922-43b9-babc-4e32bd0dcb1f</uuid>
Nov 10 11:51:00 user nova-compute[74889]:   <name>instance-00000004</name>
Nov 10 11:51:00 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:51:00 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:51:00 user nova-compute[74889]:   <metadata>
Nov 10 11:51:00 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:51:00 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:51:00 user nova-compute[74889]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-403710932</nova:name>
Nov 10 11:51:00 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:50:59</nova:creationTime>
Nov 10 11:51:00 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:51:00 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:51:00 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:51:00 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:51:00 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:51:00 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:51:00 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:51:00 user nova-compute[74889]:       <nova:owner>
Nov 10 11:51:00 user nova-compute[74889]:         <nova:user uuid="8849d2da16fa406ba5db2b5995dfa172">tempest-AttachSCSIVolumeTestJSON-254135104-project-member</nova:user>
Nov 10 11:51:00 user nova-compute[74889]:         <nova:project uuid="869f808d49da47e2a1fd50043a85cd2d">tempest-AttachSCSIVolumeTestJSON-254135104</nova:project>
Nov 10 11:51:00 user nova-compute[74889]:       </nova:owner>
Nov 10 11:51:00 user nova-compute[74889]:       <nova:root type="image" uuid="acf5b0a4-99b0-4569-b39f-e59bcd9383eb"/>
Nov 10 11:51:00 user nova-compute[74889]:       <nova:ports>
Nov 10 11:51:00 user nova-compute[74889]:         <nova:port uuid="9c692175-8e5b-4186-b654-169463411093">
Nov 10 11:51:00 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 11:51:00 user nova-compute[74889]:         </nova:port>
Nov 10 11:51:00 user nova-compute[74889]:       </nova:ports>
Nov 10 11:51:00 user nova-compute[74889]:     </nova:instance>
Nov 10 11:51:00 user nova-compute[74889]:   </metadata>
Nov 10 11:51:00 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:51:00 user nova-compute[74889]:     <system>
Nov 10 11:51:00 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:51:00 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:51:00 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:51:00 user nova-compute[74889]:       <entry name="serial">133007ba-7922-43b9-babc-4e32bd0dcb1f</entry>
Nov 10 11:51:00 user nova-compute[74889]:       <entry name="uuid">133007ba-7922-43b9-babc-4e32bd0dcb1f</entry>
Nov 10 11:51:00 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:51:00 user nova-compute[74889]:     </system>
Nov 10 11:51:00 user nova-compute[74889]:   </sysinfo>
Nov 10 11:51:00 user nova-compute[74889]:   <os>
Nov 10 11:51:00 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:51:00 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:51:00 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:51:00 user nova-compute[74889]:   </os>
Nov 10 11:51:00 user nova-compute[74889]:   <features>
Nov 10 11:51:00 user nova-compute[74889]:     <acpi/>
Nov 10 11:51:00 user nova-compute[74889]:     <apic/>
Nov 10 11:51:00 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:51:00 user nova-compute[74889]:   </features>
Nov 10 11:51:00 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:51:00 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:51:00 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:51:00 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:51:00 user nova-compute[74889]:   </clock>
Nov 10 11:51:00 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:51:00 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:51:00 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:51:00 user nova-compute[74889]:   </cpu>
Nov 10 11:51:00 user nova-compute[74889]:   <devices>
Nov 10 11:51:00 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:51:00 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:51:00 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk"/>
Nov 10 11:51:00 user nova-compute[74889]:       <target dev="sda" bus="scsi"/>
Nov 10 11:51:00 user nova-compute[74889]:       <address type="drive" controller="0" unit="0"/>
Nov 10 11:51:00 user nova-compute[74889]:     </disk>
Nov 10 11:51:00 user nova-compute[74889]:     <disk type="file" device="cdrom">
Nov 10 11:51:00 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 11:51:00 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk.config"/>
Nov 10 11:51:00 user nova-compute[74889]:       <target dev="sdb" bus="scsi"/>
Nov 10 11:51:00 user nova-compute[74889]:       <address type="drive" controller="0" unit="1"/>
Nov 10 11:51:00 user nova-compute[74889]:     </disk>
Nov 10 11:51:00 user nova-compute[74889]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 10 11:51:00 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:51:00 user nova-compute[74889]:       <mac address="fa:16:3e:aa:3d:42"/>
Nov 10 11:51:00 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:51:00 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:51:00 user nova-compute[74889]:       <target dev="tap9c692175-8e"/>
Nov 10 11:51:00 user nova-compute[74889]:     </interface>
Nov 10 11:51:00 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:51:00 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/console.log" append="off"/>
Nov 10 11:51:00 user nova-compute[74889]:     </serial>
Nov 10 11:51:00 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:51:00 user nova-compute[74889]:     <video>
Nov 10 11:51:00 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:51:00 user nova-compute[74889]:     </video>
Nov 10 11:51:00 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:51:00 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:51:00 user nova-compute[74889]:     </rng>
Nov 10 11:51:00 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:51:00 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:51:00 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:51:00 user nova-compute[74889]:     </memballoon>
Nov 10 11:51:00 user nova-compute[74889]:   </devices>
Nov 10 11:51:00 user nova-compute[74889]: </domain>
Nov 10 11:51:00 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-403710932',display_name='tempest-AttachSCSIVolumeTestJSON-server-403710932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-403710932',id=4,image_ref='acf5b0a4-99b0-4569-b39f-e59bcd9383eb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHM75RrC5nApOj2YPB9B1Mv5sVmRnmkVj66dQe/Vq4BKc9az1bySWoDRZ1+unImAEuSNnpM2nXi/O+WG8lAuO2qq3XO42vwk2lzLhWWafemNxWDFmbg6/RYinP5pWc8uHQ==',key_name='tempest-keypair-582329993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='869f808d49da47e2a1fd50043a85cd2d',ramdisk_id='',reservation_id='r-wqs415hp',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='acf5b0a4-99b0-4569-b39f-e59bcd9383eb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-254135104',owner_user_name='tempest-AttachSCSIVolumeTestJSON-254135104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8849d2da16fa406ba5db2b5995dfa172',uuid=133007ba-7922-43b9-babc-4e32bd0dcb1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Converting VIF {"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3d:42,bridge_name='br-int',has_traffic_filtering=True,id=9c692175-8e5b-4186-b654-169463411093,network=Network(c13ac228-5f2f-4683-90f7-df4d9313c9b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c692175-8e') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG os_vif [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3d:42,bridge_name='br-int',has_traffic_filtering=True,id=9c692175-8e5b-4186-b654-169463411093,network=Network(c13ac228-5f2f-4683-90f7-df4d9313c9b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c692175-8e') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41057afd-c1b9-5e71-8fd3-637a5112bbe1', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c692175-8e, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c692175-8e, col_values=(('qos', UUID('47894edd-dca9-4bd7-bb7b-8458b0c38cc5')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c692175-8e, col_values=(('external_ids', {'iface-id': '9c692175-8e5b-4186-b654-169463411093', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:3d:42', 'vm-uuid': '133007ba-7922-43b9-babc-4e32bd0dcb1f'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:00 user nova-compute[74889]: INFO os_vif [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:3d:42,bridge_name='br-int',has_traffic_filtering=True,id=9c692175-8e5b-4186-b654-169463411093,network=Network(c13ac228-5f2f-4683-90f7-df4d9313c9b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c692175-8e')
Nov 10 11:51:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] No BDM found with device name sda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] No VIF found with MAC fa:16:3e:aa:3d:42, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:51:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Using config drive
Nov 10 11:51:00 user nova-compute[74889]: DEBUG nova.network.neutron [req-52b3462d-b101-4162-bd90-fd861e48ee18 req-af8f4065-e1a2-4be7-965d-a8d35601cec2 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Updated VIF entry in instance network info cache for port 9c692175-8e5b-4186-b654-169463411093. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG nova.network.neutron [req-52b3462d-b101-4162-bd90-fd861e48ee18 req-af8f4065-e1a2-4be7-965d-a8d35601cec2 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Updating instance_info_cache with network_info: [{"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-52b3462d-b101-4162-bd90-fd861e48ee18 req-af8f4065-e1a2-4be7-965d-a8d35601cec2 service nova] Releasing lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:51:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Creating config drive at /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk.config
Nov 10 11:51:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkavgu5uf {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkavgu5uf" returned: 0 in 0.064s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-fa1c8318-6277-443d-8245-1b9c46d4bae1 req-9da1abf9-e5cc-42b5-ad7c-fc34b04bbc2b service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received event network-vif-plugged-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fa1c8318-6277-443d-8245-1b9c46d4bae1 req-9da1abf9-e5cc-42b5-ad7c-fc34b04bbc2b service nova] Acquiring lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fa1c8318-6277-443d-8245-1b9c46d4bae1 req-9da1abf9-e5cc-42b5-ad7c-fc34b04bbc2b service nova] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fa1c8318-6277-443d-8245-1b9c46d4bae1 req-9da1abf9-e5cc-42b5-ad7c-fc34b04bbc2b service nova] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-fa1c8318-6277-443d-8245-1b9c46d4bae1 req-9da1abf9-e5cc-42b5-ad7c-fc34b04bbc2b service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] No waiting events found dispatching network-vif-plugged-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:51:02 user nova-compute[74889]: WARNING nova.compute.manager [req-fa1c8318-6277-443d-8245-1b9c46d4bae1 req-9da1abf9-e5cc-42b5-ad7c-fc34b04bbc2b service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received unexpected event network-vif-plugged-9c692175-8e5b-4186-b654-169463411093 for instance with vm_state building and task_state spawning.
Nov 10 11:51:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-e8c66224-dd5e-4aab-bfa2-a526cc048dfd req-f352e48d-c552-47e5-b714-3c6edc90d77a service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e8c66224-dd5e-4aab-bfa2-a526cc048dfd req-f352e48d-c552-47e5-b714-3c6edc90d77a service nova] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e8c66224-dd5e-4aab-bfa2-a526cc048dfd req-f352e48d-c552-47e5-b714-3c6edc90d77a service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e8c66224-dd5e-4aab-bfa2-a526cc048dfd req-f352e48d-c552-47e5-b714-3c6edc90d77a service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-e8c66224-dd5e-4aab-bfa2-a526cc048dfd req-f352e48d-c552-47e5-b714-3c6edc90d77a service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] No waiting events found dispatching network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:51:04 user nova-compute[74889]: WARNING nova.compute.manager [req-e8c66224-dd5e-4aab-bfa2-a526cc048dfd req-f352e48d-c552-47e5-b714-3c6edc90d77a service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received unexpected event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 for instance with vm_state active and task_state None.
Nov 10 11:51:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-25d1b488-8ead-45db-80fa-6c32bed9f46b req-fada8615-c2fd-4edf-b985-1a1359458aa0 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received event network-vif-plugged-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-25d1b488-8ead-45db-80fa-6c32bed9f46b req-fada8615-c2fd-4edf-b985-1a1359458aa0 service nova] Acquiring lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-25d1b488-8ead-45db-80fa-6c32bed9f46b req-fada8615-c2fd-4edf-b985-1a1359458aa0 service nova] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-25d1b488-8ead-45db-80fa-6c32bed9f46b req-fada8615-c2fd-4edf-b985-1a1359458aa0 service nova] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-25d1b488-8ead-45db-80fa-6c32bed9f46b req-fada8615-c2fd-4edf-b985-1a1359458aa0 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] No waiting events found dispatching network-vif-plugged-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:51:04 user nova-compute[74889]: WARNING nova.compute.manager [req-25d1b488-8ead-45db-80fa-6c32bed9f46b req-fada8615-c2fd-4edf-b985-1a1359458aa0 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received unexpected event network-vif-plugged-9c692175-8e5b-4186-b654-169463411093 for instance with vm_state building and task_state spawning.
Nov 10 11:51:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:51:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:51:06 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Instance spawned successfully.
Nov 10 11:51:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:51:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:06 user nova-compute[74889]: INFO nova.compute.manager [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Took 9.45 seconds to spawn the instance on the hypervisor.
Nov 10 11:51:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:51:06 user nova-compute[74889]: INFO nova.compute.manager [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Took 10.53 seconds to build instance.
Nov 10 11:51:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3a5574a1-4cb7-4188-bdd0-6c3e44c88184 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.713s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-f326dfb0-0c9e-4386-961b-6917168e8eb1 req-3f02d40a-d28d-4cbf-a943-0c1535419338 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f326dfb0-0c9e-4386-961b-6917168e8eb1 req-3f02d40a-d28d-4cbf-a943-0c1535419338 service nova] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f326dfb0-0c9e-4386-961b-6917168e8eb1 req-3f02d40a-d28d-4cbf-a943-0c1535419338 service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f326dfb0-0c9e-4386-961b-6917168e8eb1 req-3f02d40a-d28d-4cbf-a943-0c1535419338 service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-f326dfb0-0c9e-4386-961b-6917168e8eb1 req-3f02d40a-d28d-4cbf-a943-0c1535419338 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] No waiting events found dispatching network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:51:07 user nova-compute[74889]: WARNING nova.compute.manager [req-f326dfb0-0c9e-4386-961b-6917168e8eb1 req-3f02d40a-d28d-4cbf-a943-0c1535419338 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received unexpected event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 for instance with vm_state active and task_state None.
Nov 10 11:51:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Acquiring lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:51:09 user nova-compute[74889]: INFO nova.compute.claims [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Claim successful on node user
Nov 10 11:51:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:51:09 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.265s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:51:10 user nova-compute[74889]: INFO nova.compute.claims [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Claim successful on node user
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.network.neutron [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:51:10 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.policy [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fe0e1832aea4faaaf4231c534ce5677', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59070eb884ca43ddabc579ef81f9701e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:51:10 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Creating image(s)
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Acquiring lock "/opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "/opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "/opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.216s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:51:10 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.policy [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5894f3d255b24f478b4a7587af72e78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2a54fb5d501431ea3386ebb82603036', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.243s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.network.neutron [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Successfully created port: 84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:51:10 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Creating image(s)
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "/opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "/opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "/opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk 1073741824" returned: 0 in 0.080s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.275s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Cannot resize image /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Ensure instance console log exists: /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.254s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk 1073741824" returned: 0 in 0.063s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-043cd296-5dfc-49f1-ada4-3d0e74dffbbc req-a85f2eb5-6016-44bd-8830-7e590490c48c service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-043cd296-5dfc-49f1-ada4-3d0e74dffbbc req-a85f2eb5-6016-44bd-8830-7e590490c48c service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-043cd296-5dfc-49f1-ada4-3d0e74dffbbc req-a85f2eb5-6016-44bd-8830-7e590490c48c service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-043cd296-5dfc-49f1-ada4-3d0e74dffbbc req-a85f2eb5-6016-44bd-8830-7e590490c48c service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-043cd296-5dfc-49f1-ada4-3d0e74dffbbc req-a85f2eb5-6016-44bd-8830-7e590490c48c service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:51:11 user nova-compute[74889]: WARNING nova.compute.manager [req-043cd296-5dfc-49f1-ada4-3d0e74dffbbc req-a85f2eb5-6016-44bd-8830-7e590490c48c service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state active and task_state None.
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.network.neutron [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Successfully updated port: 84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Acquiring lock "refresh_cache-330f6b5b-9e60-42bf-be67-981a13e29ef4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Acquired lock "refresh_cache-330f6b5b-9e60-42bf-be67-981a13e29ef4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.network.neutron [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-af8a1347-8c05-4269-af1e-7ff621e5a4d1 req-4ae4893b-312e-4731-af2b-e16b5c6785a1 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received event network-changed-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-af8a1347-8c05-4269-af1e-7ff621e5a4d1 req-4ae4893b-312e-4731-af2b-e16b5c6785a1 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Refreshing instance network info cache due to event network-changed-84a0b161-daed-42f6-8f9f-61cacf7c4798. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-af8a1347-8c05-4269-af1e-7ff621e5a4d1 req-4ae4893b-312e-4731-af2b-e16b5c6785a1 service nova] Acquiring lock "refresh_cache-330f6b5b-9e60-42bf-be67-981a13e29ef4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Successfully created port: 7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.network.neutron [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Cannot resize image /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Ensure instance console log exists: /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.neutron [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Updating instance_info_cache with network_info: [{"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Releasing lock "refresh_cache-330f6b5b-9e60-42bf-be67-981a13e29ef4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.compute.manager [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Instance network_info: |[{"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-af8a1347-8c05-4269-af1e-7ff621e5a4d1 req-4ae4893b-312e-4731-af2b-e16b5c6785a1 service nova] Acquired lock "refresh_cache-330f6b5b-9e60-42bf-be67-981a13e29ef4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.neutron [req-af8a1347-8c05-4269-af1e-7ff621e5a4d1 req-4ae4893b-312e-4731-af2b-e16b5c6785a1 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Refreshing network info cache for port 84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Start _get_guest_xml network_info=[{"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:51:12 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:51:12 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-870779479',display_name='tempest-VolumesAssistedSnapshotsTest-server-870779479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-870779479',id=5,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcRqg/O6xMDUO4fB7D+pdYMkKFeJvOQcA7E7cqgulnDE61JbF/h8dqSyzouKe1waT6OUHU6ouG2XzwLPp1tCTMOlNWoaflFUfbbyQV4V0jKwRQ/zz24wfO/9ZW6ScBNRQ==',key_name='tempest-keypair-648246847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59070eb884ca43ddabc579ef81f9701e',ramdisk_id='',reservation_id='r-1rojingg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-540390099',owner_user_name='tempest-VolumesAssistedSnapshotsTest-540390099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:51:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fe0e1832aea4faaaf4231c534ce5677',uuid=330f6b5b-9e60-42bf-be67-981a13e29ef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Converting VIF {"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:80:af,bridge_name='br-int',has_traffic_filtering=True,id=84a0b161-daed-42f6-8f9f-61cacf7c4798,network=Network(af3de3f0-a686-4f7c-9275-f33dd525e8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a0b161-da') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.objects.instance [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lazy-loading 'pci_devices' on Instance uuid 330f6b5b-9e60-42bf-be67-981a13e29ef4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:51:12 user nova-compute[74889]:   <uuid>330f6b5b-9e60-42bf-be67-981a13e29ef4</uuid>
Nov 10 11:51:12 user nova-compute[74889]:   <name>instance-00000005</name>
Nov 10 11:51:12 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:51:12 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:51:12 user nova-compute[74889]:   <metadata>
Nov 10 11:51:12 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:51:12 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:51:12 user nova-compute[74889]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-870779479</nova:name>
Nov 10 11:51:12 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:51:12</nova:creationTime>
Nov 10 11:51:12 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:51:12 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:51:12 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:51:12 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:51:12 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:51:12 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:51:12 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:51:12 user nova-compute[74889]:       <nova:owner>
Nov 10 11:51:12 user nova-compute[74889]:         <nova:user uuid="2fe0e1832aea4faaaf4231c534ce5677">tempest-VolumesAssistedSnapshotsTest-540390099-project-member</nova:user>
Nov 10 11:51:12 user nova-compute[74889]:         <nova:project uuid="59070eb884ca43ddabc579ef81f9701e">tempest-VolumesAssistedSnapshotsTest-540390099</nova:project>
Nov 10 11:51:12 user nova-compute[74889]:       </nova:owner>
Nov 10 11:51:12 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:51:12 user nova-compute[74889]:       <nova:ports>
Nov 10 11:51:12 user nova-compute[74889]:         <nova:port uuid="84a0b161-daed-42f6-8f9f-61cacf7c4798">
Nov 10 11:51:12 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 11:51:12 user nova-compute[74889]:         </nova:port>
Nov 10 11:51:12 user nova-compute[74889]:       </nova:ports>
Nov 10 11:51:12 user nova-compute[74889]:     </nova:instance>
Nov 10 11:51:12 user nova-compute[74889]:   </metadata>
Nov 10 11:51:12 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:51:12 user nova-compute[74889]:     <system>
Nov 10 11:51:12 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:51:12 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:51:12 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:51:12 user nova-compute[74889]:       <entry name="serial">330f6b5b-9e60-42bf-be67-981a13e29ef4</entry>
Nov 10 11:51:12 user nova-compute[74889]:       <entry name="uuid">330f6b5b-9e60-42bf-be67-981a13e29ef4</entry>
Nov 10 11:51:12 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:51:12 user nova-compute[74889]:     </system>
Nov 10 11:51:12 user nova-compute[74889]:   </sysinfo>
Nov 10 11:51:12 user nova-compute[74889]:   <os>
Nov 10 11:51:12 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:51:12 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:51:12 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:51:12 user nova-compute[74889]:   </os>
Nov 10 11:51:12 user nova-compute[74889]:   <features>
Nov 10 11:51:12 user nova-compute[74889]:     <acpi/>
Nov 10 11:51:12 user nova-compute[74889]:     <apic/>
Nov 10 11:51:12 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:51:12 user nova-compute[74889]:   </features>
Nov 10 11:51:12 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:51:12 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:51:12 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:51:12 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:51:12 user nova-compute[74889]:   </clock>
Nov 10 11:51:12 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:51:12 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:51:12 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:51:12 user nova-compute[74889]:   </cpu>
Nov 10 11:51:12 user nova-compute[74889]:   <devices>
Nov 10 11:51:12 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:51:12 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:51:12 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk"/>
Nov 10 11:51:12 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:51:12 user nova-compute[74889]:     </disk>
Nov 10 11:51:12 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:51:12 user nova-compute[74889]:       <mac address="fa:16:3e:bc:80:af"/>
Nov 10 11:51:12 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:51:12 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:51:12 user nova-compute[74889]:       <target dev="tap84a0b161-da"/>
Nov 10 11:51:12 user nova-compute[74889]:     </interface>
Nov 10 11:51:12 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:51:12 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/console.log" append="off"/>
Nov 10 11:51:12 user nova-compute[74889]:     </serial>
Nov 10 11:51:12 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:51:12 user nova-compute[74889]:     <video>
Nov 10 11:51:12 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:51:12 user nova-compute[74889]:     </video>
Nov 10 11:51:12 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:51:12 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:51:12 user nova-compute[74889]:     </rng>
Nov 10 11:51:12 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:51:12 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:51:12 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:51:12 user nova-compute[74889]:     </memballoon>
Nov 10 11:51:12 user nova-compute[74889]:   </devices>
Nov 10 11:51:12 user nova-compute[74889]: </domain>
Nov 10 11:51:12 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-870779479',display_name='tempest-VolumesAssistedSnapshotsTest-server-870779479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-870779479',id=5,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcRqg/O6xMDUO4fB7D+pdYMkKFeJvOQcA7E7cqgulnDE61JbF/h8dqSyzouKe1waT6OUHU6ouG2XzwLPp1tCTMOlNWoaflFUfbbyQV4V0jKwRQ/zz24wfO/9ZW6ScBNRQ==',key_name='tempest-keypair-648246847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59070eb884ca43ddabc579ef81f9701e',ramdisk_id='',reservation_id='r-1rojingg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-540390099',owner_user_name='tempest-VolumesAssistedSnapshotsTest-540390099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:51:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fe0e1832aea4faaaf4231c534ce5677',uuid=330f6b5b-9e60-42bf-be67-981a13e29ef4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Converting VIF {"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:80:af,bridge_name='br-int',has_traffic_filtering=True,id=84a0b161-daed-42f6-8f9f-61cacf7c4798,network=Network(af3de3f0-a686-4f7c-9275-f33dd525e8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a0b161-da') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG os_vif [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:80:af,bridge_name='br-int',has_traffic_filtering=True,id=84a0b161-daed-42f6-8f9f-61cacf7c4798,network=Network(af3de3f0-a686-4f7c-9275-f33dd525e8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a0b161-da') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98391c61-81a0-5258-9230-e235f4ba3335', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84a0b161-da, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84a0b161-da, col_values=(('qos', UUID('ece3cd46-ede8-4ec6-88ac-8cae9df6fb05')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84a0b161-da, col_values=(('external_ids', {'iface-id': '84a0b161-daed-42f6-8f9f-61cacf7c4798', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:80:af', 'vm-uuid': '330f6b5b-9e60-42bf-be67-981a13e29ef4'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:12 user nova-compute[74889]: INFO os_vif [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:80:af,bridge_name='br-int',has_traffic_filtering=True,id=84a0b161-daed-42f6-8f9f-61cacf7c4798,network=Network(af3de3f0-a686-4f7c-9275-f33dd525e8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a0b161-da')
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] No VIF found with MAC fa:16:3e:bc:80:af, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.neutron [req-af8a1347-8c05-4269-af1e-7ff621e5a4d1 req-4ae4893b-312e-4731-af2b-e16b5c6785a1 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Updated VIF entry in instance network info cache for port 84a0b161-daed-42f6-8f9f-61cacf7c4798. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.neutron [req-af8a1347-8c05-4269-af1e-7ff621e5a4d1 req-4ae4893b-312e-4731-af2b-e16b5c6785a1 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Updating instance_info_cache with network_info: [{"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-af8a1347-8c05-4269-af1e-7ff621e5a4d1 req-4ae4893b-312e-4731-af2b-e16b5c6785a1 service nova] Releasing lock "refresh_cache-330f6b5b-9e60-42bf-be67-981a13e29ef4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Successfully updated port: 7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquired lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:51:12 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Updating instance_info_cache with network_info: [{"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Releasing lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Instance network_info: |[{"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Start _get_guest_xml network_info=[{"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:51:13 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:51:13 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-106218730',display_name='tempest-TestVolumeSwap-server-106218730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-106218730',id=6,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU5wPeUeVohvI0vZVD7C9+8n7jRnNsPWKCqS4cekrg0OqZ2ROg7QXhARlmCm1JKFKfAIJ6joB1SKAZeyJdZE3Cx7unFhPAp16aHQ/AgBx5Tki1uUucG4EuFgvDPuoVR8Q==',key_name='tempest-keypair-1297191324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2a54fb5d501431ea3386ebb82603036',ramdisk_id='',reservation_id='r-08dxjhgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-316523943',owner_user_name='tempest-TestVolumeSwap-316523943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:51:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5894f3d255b24f478b4a7587af72e78f',uuid=62224c8d-72a9-449a-ab5b-376197157c3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Converting VIF {"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fb:1d,bridge_name='br-int',has_traffic_filtering=True,id=7d5ab299-1af9-4966-ba6d-12e8ebe7087b,network=Network(8aedc35e-710b-417f-a155-721b994769b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5ab299-1a') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lazy-loading 'pci_devices' on Instance uuid 62224c8d-72a9-449a-ab5b-376197157c3e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:51:13 user nova-compute[74889]:   <uuid>62224c8d-72a9-449a-ab5b-376197157c3e</uuid>
Nov 10 11:51:13 user nova-compute[74889]:   <name>instance-00000006</name>
Nov 10 11:51:13 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:51:13 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:51:13 user nova-compute[74889]:   <metadata>
Nov 10 11:51:13 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:51:13 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:51:13 user nova-compute[74889]:       <nova:name>tempest-TestVolumeSwap-server-106218730</nova:name>
Nov 10 11:51:13 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:51:13</nova:creationTime>
Nov 10 11:51:13 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:51:13 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:51:13 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:51:13 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:51:13 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:51:13 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:51:13 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:51:13 user nova-compute[74889]:       <nova:owner>
Nov 10 11:51:13 user nova-compute[74889]:         <nova:user uuid="5894f3d255b24f478b4a7587af72e78f">tempest-TestVolumeSwap-316523943-project-member</nova:user>
Nov 10 11:51:13 user nova-compute[74889]:         <nova:project uuid="e2a54fb5d501431ea3386ebb82603036">tempest-TestVolumeSwap-316523943</nova:project>
Nov 10 11:51:13 user nova-compute[74889]:       </nova:owner>
Nov 10 11:51:13 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:51:13 user nova-compute[74889]:       <nova:ports>
Nov 10 11:51:13 user nova-compute[74889]:         <nova:port uuid="7d5ab299-1af9-4966-ba6d-12e8ebe7087b">
Nov 10 11:51:13 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 11:51:13 user nova-compute[74889]:         </nova:port>
Nov 10 11:51:13 user nova-compute[74889]:       </nova:ports>
Nov 10 11:51:13 user nova-compute[74889]:     </nova:instance>
Nov 10 11:51:13 user nova-compute[74889]:   </metadata>
Nov 10 11:51:13 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:51:13 user nova-compute[74889]:     <system>
Nov 10 11:51:13 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:51:13 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:51:13 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:51:13 user nova-compute[74889]:       <entry name="serial">62224c8d-72a9-449a-ab5b-376197157c3e</entry>
Nov 10 11:51:13 user nova-compute[74889]:       <entry name="uuid">62224c8d-72a9-449a-ab5b-376197157c3e</entry>
Nov 10 11:51:13 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:51:13 user nova-compute[74889]:     </system>
Nov 10 11:51:13 user nova-compute[74889]:   </sysinfo>
Nov 10 11:51:13 user nova-compute[74889]:   <os>
Nov 10 11:51:13 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:51:13 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:51:13 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:51:13 user nova-compute[74889]:   </os>
Nov 10 11:51:13 user nova-compute[74889]:   <features>
Nov 10 11:51:13 user nova-compute[74889]:     <acpi/>
Nov 10 11:51:13 user nova-compute[74889]:     <apic/>
Nov 10 11:51:13 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:51:13 user nova-compute[74889]:   </features>
Nov 10 11:51:13 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:51:13 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:51:13 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:51:13 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:51:13 user nova-compute[74889]:   </clock>
Nov 10 11:51:13 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:51:13 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:51:13 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:51:13 user nova-compute[74889]:   </cpu>
Nov 10 11:51:13 user nova-compute[74889]:   <devices>
Nov 10 11:51:13 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:51:13 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:51:13 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk"/>
Nov 10 11:51:13 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:51:13 user nova-compute[74889]:     </disk>
Nov 10 11:51:13 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:51:13 user nova-compute[74889]:       <mac address="fa:16:3e:4e:fb:1d"/>
Nov 10 11:51:13 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:51:13 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:51:13 user nova-compute[74889]:       <target dev="tap7d5ab299-1a"/>
Nov 10 11:51:13 user nova-compute[74889]:     </interface>
Nov 10 11:51:13 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:51:13 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/console.log" append="off"/>
Nov 10 11:51:13 user nova-compute[74889]:     </serial>
Nov 10 11:51:13 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:51:13 user nova-compute[74889]:     <video>
Nov 10 11:51:13 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:51:13 user nova-compute[74889]:     </video>
Nov 10 11:51:13 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:51:13 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:51:13 user nova-compute[74889]:     </rng>
Nov 10 11:51:13 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:51:13 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:51:13 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:51:13 user nova-compute[74889]:     </memballoon>
Nov 10 11:51:13 user nova-compute[74889]:   </devices>
Nov 10 11:51:13 user nova-compute[74889]: </domain>
Nov 10 11:51:13 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-106218730',display_name='tempest-TestVolumeSwap-server-106218730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-106218730',id=6,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU5wPeUeVohvI0vZVD7C9+8n7jRnNsPWKCqS4cekrg0OqZ2ROg7QXhARlmCm1JKFKfAIJ6joB1SKAZeyJdZE3Cx7unFhPAp16aHQ/AgBx5Tki1uUucG4EuFgvDPuoVR8Q==',key_name='tempest-keypair-1297191324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2a54fb5d501431ea3386ebb82603036',ramdisk_id='',reservation_id='r-08dxjhgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-316523943',owner_user_name='tempest-TestVolumeSwap-316523943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:51:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5894f3d255b24f478b4a7587af72e78f',uuid=62224c8d-72a9-449a-ab5b-376197157c3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Converting VIF {"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fb:1d,bridge_name='br-int',has_traffic_filtering=True,id=7d5ab299-1af9-4966-ba6d-12e8ebe7087b,network=Network(8aedc35e-710b-417f-a155-721b994769b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5ab299-1a') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG os_vif [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fb:1d,bridge_name='br-int',has_traffic_filtering=True,id=7d5ab299-1af9-4966-ba6d-12e8ebe7087b,network=Network(8aedc35e-710b-417f-a155-721b994769b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5ab299-1a') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f592f047-b563-528e-ae74-94165b5244d2', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d5ab299-1a, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d5ab299-1a, col_values=(('qos', UUID('625cc0e4-7625-485a-85fc-8bc96164caaa')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d5ab299-1a, col_values=(('external_ids', {'iface-id': '7d5ab299-1af9-4966-ba6d-12e8ebe7087b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:fb:1d', 'vm-uuid': '62224c8d-72a9-449a-ab5b-376197157c3e'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:13 user nova-compute[74889]: INFO os_vif [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:fb:1d,bridge_name='br-int',has_traffic_filtering=True,id=7d5ab299-1af9-4966-ba6d-12e8ebe7087b,network=Network(8aedc35e-710b-417f-a155-721b994769b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5ab299-1a')
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] No VIF found with MAC fa:16:3e:4e:fb:1d, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:51:13 user nova-compute[74889]: WARNING nova.compute.manager [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state active and task_state None.
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received event network-changed-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Refreshing instance network info cache due to event network-changed-7d5ab299-1af9-4966-ba6d-12e8ebe7087b. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] Acquiring lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] Acquired lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:51:13 user nova-compute[74889]: DEBUG nova.network.neutron [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Refreshing network info cache for port 7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG nova.network.neutron [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Updated VIF entry in instance network info cache for port 7d5ab299-1af9-4966-ba6d-12e8ebe7087b. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG nova.network.neutron [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Updating instance_info_cache with network_info: [{"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-09babcee-5d3d-4a0a-b71d-b7ecc3ebc4ff req-2ad11a76-1adf-4e23-ae2c-0c91919b1585 service nova] Releasing lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-00583452-a6ec-45f6-bb59-eca75756a266 req-d3ab0828-ef4b-4700-93fe-1a7dee078558 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received event network-vif-plugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-00583452-a6ec-45f6-bb59-eca75756a266 req-d3ab0828-ef4b-4700-93fe-1a7dee078558 service nova] Acquiring lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-00583452-a6ec-45f6-bb59-eca75756a266 req-d3ab0828-ef4b-4700-93fe-1a7dee078558 service nova] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-00583452-a6ec-45f6-bb59-eca75756a266 req-d3ab0828-ef4b-4700-93fe-1a7dee078558 service nova] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-00583452-a6ec-45f6-bb59-eca75756a266 req-d3ab0828-ef4b-4700-93fe-1a7dee078558 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] No waiting events found dispatching network-vif-plugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:51:14 user nova-compute[74889]: WARNING nova.compute.manager [req-00583452-a6ec-45f6-bb59-eca75756a266 req-d3ab0828-ef4b-4700-93fe-1a7dee078558 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received unexpected event network-vif-plugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 for instance with vm_state building and task_state spawning.
Nov 10 11:51:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-f254dd8c-f204-4501-ae56-67309de590f0 req-1cbcfccb-2ccd-4cc1-b15b-1f4b03421ad5 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received event network-vif-plugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f254dd8c-f204-4501-ae56-67309de590f0 req-1cbcfccb-2ccd-4cc1-b15b-1f4b03421ad5 service nova] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f254dd8c-f204-4501-ae56-67309de590f0 req-1cbcfccb-2ccd-4cc1-b15b-1f4b03421ad5 service nova] Lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f254dd8c-f204-4501-ae56-67309de590f0 req-1cbcfccb-2ccd-4cc1-b15b-1f4b03421ad5 service nova] Lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-f254dd8c-f204-4501-ae56-67309de590f0 req-1cbcfccb-2ccd-4cc1-b15b-1f4b03421ad5 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] No waiting events found dispatching network-vif-plugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:51:16 user nova-compute[74889]: WARNING nova.compute.manager [req-f254dd8c-f204-4501-ae56-67309de590f0 req-1cbcfccb-2ccd-4cc1-b15b-1f4b03421ad5 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received unexpected event network-vif-plugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b for instance with vm_state building and task_state spawning.
Nov 10 11:51:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-2c7afa97-ab4d-4194-b2fd-0e4c5c09d38f req-a6988679-1a19-47ca-8528-597239bddb1f service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received event network-vif-plugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2c7afa97-ab4d-4194-b2fd-0e4c5c09d38f req-a6988679-1a19-47ca-8528-597239bddb1f service nova] Acquiring lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2c7afa97-ab4d-4194-b2fd-0e4c5c09d38f req-a6988679-1a19-47ca-8528-597239bddb1f service nova] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2c7afa97-ab4d-4194-b2fd-0e4c5c09d38f req-a6988679-1a19-47ca-8528-597239bddb1f service nova] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-2c7afa97-ab4d-4194-b2fd-0e4c5c09d38f req-a6988679-1a19-47ca-8528-597239bddb1f service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] No waiting events found dispatching network-vif-plugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:51:16 user nova-compute[74889]: WARNING nova.compute.manager [req-2c7afa97-ab4d-4194-b2fd-0e4c5c09d38f req-a6988679-1a19-47ca-8528-597239bddb1f service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received unexpected event network-vif-plugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 for instance with vm_state building and task_state spawning.
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-366e04d2-c4ba-40e5-bc03-fc2f8a2244a0 req-542d6ff1-52b2-44cb-b271-2d1c5b9ca18d service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received event network-vif-plugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-366e04d2-c4ba-40e5-bc03-fc2f8a2244a0 req-542d6ff1-52b2-44cb-b271-2d1c5b9ca18d service nova] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-366e04d2-c4ba-40e5-bc03-fc2f8a2244a0 req-542d6ff1-52b2-44cb-b271-2d1c5b9ca18d service nova] Lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-366e04d2-c4ba-40e5-bc03-fc2f8a2244a0 req-542d6ff1-52b2-44cb-b271-2d1c5b9ca18d service nova] Lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-366e04d2-c4ba-40e5-bc03-fc2f8a2244a0 req-542d6ff1-52b2-44cb-b271-2d1c5b9ca18d service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] No waiting events found dispatching network-vif-plugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:51:18 user nova-compute[74889]: WARNING nova.compute.manager [req-366e04d2-c4ba-40e5-bc03-fc2f8a2244a0 req-542d6ff1-52b2-44cb-b271-2d1c5b9ca18d service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received unexpected event network-vif-plugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b for instance with vm_state building and task_state spawning.
Nov 10 11:51:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:51:18 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Instance spawned successfully.
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:51:18 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Instance spawned successfully.
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:51:18 user nova-compute[74889]: INFO nova.compute.manager [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Took 7.77 seconds to spawn the instance on the hypervisor.
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:51:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:18 user nova-compute[74889]: INFO nova.compute.manager [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Took 8.35 seconds to spawn the instance on the hypervisor.
Nov 10 11:51:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:51:18 user nova-compute[74889]: INFO nova.compute.manager [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Took 9.12 seconds to build instance.
Nov 10 11:51:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7c0b61fb-3153-47f8-8b12-ad02e10d956d tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.260s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:18 user nova-compute[74889]: INFO nova.compute.manager [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Took 9.43 seconds to build instance.
Nov 10 11:51:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bd4dc8cf-164d-431d-a1ee-d4f2f2247e63 tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.583s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 11:51:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 11:51:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 11:51:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:30 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:51:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:33 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:51:33 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:51:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7979MB free_disk=25.756694793701172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 03f62fe3-a6ce-45bc-a99a-4d134b330c1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 133007ba-7922-43b9-babc-4e32bd0dcb1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 62224c8d-72a9-449a-ab5b-376197157c3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:51:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:51:34 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:51:34 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:51:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:51:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-03f62fe3-a6ce-45bc-a99a-4d134b330c1e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-03f62fe3-a6ce-45bc-a99a-4d134b330c1e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid 03f62fe3-a6ce-45bc-a99a-4d134b330c1e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Updating instance_info_cache with network_info: [{"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-03f62fe3-a6ce-45bc-a99a-4d134b330c1e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:51:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:51:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:51:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:52:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:05 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:52:05 user nova-compute[74889]: INFO nova.compute.claims [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Claim successful on node user
Nov 10 11:52:05 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Refreshing inventories for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 11:52:05 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Updating ProviderTree inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 11:52:05 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 11:52:05 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Refreshing aggregate associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, aggregates: None {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 11:52:05 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Refreshing trait associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 11:52:06 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:52:06 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:52:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:52:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:52:06 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:52:06 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:52:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:52:06 user nova-compute[74889]: DEBUG nova.policy [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82bd448d0c3045aeb1114169f1a952b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c0db768727f4544865ec53756cf5e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:52:06 user nova-compute[74889]: INFO nova.virt.block_device [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Booting with volume 83e12811-d82a-4e65-a0b1-b4c84ecad9e3 at /dev/vda
Nov 10 11:52:06 user nova-compute[74889]: DEBUG os_brick.utils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:52:06 user nova-compute[74889]: INFO oslo.privsep.daemon [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmplw39u18n/privsep.sock']
Nov 10 11:52:06 user sudo[85598]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmplw39u18n/privsep.sock
Nov 10 11:52:06 user sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 11:52:07 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Successfully created port: da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Successfully updated port: da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "refresh_cache-54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquired lock "refresh_cache-54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-2500d8a4-833f-4b07-ae78-8a9e2494c117 req-53fa328b-1807-47b9-99e4-faf9b2b06f1d service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-changed-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-2500d8a4-833f-4b07-ae78-8a9e2494c117 req-53fa328b-1807-47b9-99e4-faf9b2b06f1d service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Refreshing instance network info cache due to event network-changed-da93881f-7f2f-401e-8dcd-a881954e3905. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2500d8a4-833f-4b07-ae78-8a9e2494c117 req-53fa328b-1807-47b9-99e4-faf9b2b06f1d service nova] Acquiring lock "refresh_cache-54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:52:08 user sudo[85598]: pam_unix(sudo:session): session closed for user root
Nov 10 11:52:08 user nova-compute[74889]: INFO oslo.privsep.daemon [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Spawned new privsep daemon via rootwrap
Nov 10 11:52:08 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 11:52:08 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 11:52:08 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 10 11:52:08 user nova-compute[74889]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85601
Nov 10 11:52:08 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Updating instance_info_cache with network_info: [{"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8aaa8c5-4915-46c6-b276-2c5857be37dc]: (2,) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Releasing lock "refresh_cache-54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Instance network_info: |[{"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2500d8a4-833f-4b07-ae78-8a9e2494c117 req-53fa328b-1807-47b9-99e4-faf9b2b06f1d service nova] Acquired lock "refresh_cache-54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG nova.network.neutron [req-2500d8a4-833f-4b07-ae78-8a9e2494c117 req-53fa328b-1807-47b9-99e4-faf9b2b06f1d service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Refreshing network info cache for port da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[04256ea7-851f-48c2-802b-be059f37c18b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:08 user nova-compute[74889]: WARNING os_brick.initiator.connectors.nvmeof [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ce31d6-5894-413a-a431-cffb0218bee5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[78009a12-2a43-4a3d-915b-f60e822e9d81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49f9bd6-0109-4579-a428-f7ba4ce9e556]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:52:08 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:52:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f2ba11-822d-4e21-93e8-117161acad23]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG os_brick.utils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] <== get_connector_properties: return (2310ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:52:08 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Updating existing volume attachment record: 4dec1446-066c-477f-8ae0-df37c17f37fa {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:52:09 user nova-compute[74889]: DEBUG nova.network.neutron [req-2500d8a4-833f-4b07-ae78-8a9e2494c117 req-53fa328b-1807-47b9-99e4-faf9b2b06f1d service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Updated VIF entry in instance network info cache for port da93881f-7f2f-401e-8dcd-a881954e3905. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:52:09 user nova-compute[74889]: DEBUG nova.network.neutron [req-2500d8a4-833f-4b07-ae78-8a9e2494c117 req-53fa328b-1807-47b9-99e4-faf9b2b06f1d service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Updating instance_info_cache with network_info: [{"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:52:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2500d8a4-833f-4b07-ae78-8a9e2494c117 req-53fa328b-1807-47b9-99e4-faf9b2b06f1d service nova] Releasing lock "refresh_cache-54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:52:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:52:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:52:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:28 user nova-compute[74889]: DEBUG nova.objects.instance [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lazy-loading 'flavor' on Instance uuid 03f62fe3-a6ce-45bc-a99a-4d134b330c1e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:52:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:29 user nova-compute[74889]: INFO nova.compute.manager [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Attaching volume ef50dbbb-659e-4236-be66-aebdc8433a65 to /dev/vdb
Nov 10 11:52:29 user nova-compute[74889]: DEBUG os_brick.utils [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[408e6f1b-2362-4497-b045-e1d576239910]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67a3a85-2f69-47af-b24c-d4e14805d8f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f976e4-e6cd-4d4b-95c4-68ce04c373ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feac344-fc5d-42e4-b0bb-85bf1608dcbd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:52:29 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:52:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeae595-42f7-479c-8b98-2e1a22066822]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG os_brick.utils [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:52:29 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Updating existing volume attachment record: 52ae3074-aa35-457e-8d5a-4c1b916b812a {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-0a4c04f5-8571-4f73-905e-f026e6643c8d req-f4c2c453-6d1a-4dd1-a125-ad5139eab263 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-changed-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-0a4c04f5-8571-4f73-905e-f026e6643c8d req-f4c2c453-6d1a-4dd1-a125-ad5139eab263 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Refreshing instance network info cache due to event network-changed-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0a4c04f5-8571-4f73-905e-f026e6643c8d req-f4c2c453-6d1a-4dd1-a125-ad5139eab263 service nova] Acquiring lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0a4c04f5-8571-4f73-905e-f026e6643c8d req-f4c2c453-6d1a-4dd1-a125-ad5139eab263 service nova] Acquired lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG nova.network.neutron [req-0a4c04f5-8571-4f73-905e-f026e6643c8d req-f4c2c453-6d1a-4dd1-a125-ad5139eab263 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Refreshing network info cache for port 5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-0a4c04f5-8571-4f73-905e-f026e6643c8d req-f4c2c453-6d1a-4dd1-a125-ad5139eab263 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updated VIF entry in instance network info cache for port 5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-0a4c04f5-8571-4f73-905e-f026e6643c8d req-f4c2c453-6d1a-4dd1-a125-ad5139eab263 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updating instance_info_cache with network_info: [{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0a4c04f5-8571-4f73-905e-f026e6643c8d req-f4c2c453-6d1a-4dd1-a125-ad5139eab263 service nova] Releasing lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-0ec4c7ae-65db-4646-9f4f-17502a0c65df req-40b10a79-721b-4ecf-91fe-9dde266e2a85 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received event network-changed-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-0ec4c7ae-65db-4646-9f4f-17502a0c65df req-40b10a79-721b-4ecf-91fe-9dde266e2a85 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Refreshing instance network info cache due to event network-changed-02539ac7-b338-4419-8c36-f8683da00cb5. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0ec4c7ae-65db-4646-9f4f-17502a0c65df req-40b10a79-721b-4ecf-91fe-9dde266e2a85 service nova] Acquiring lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0ec4c7ae-65db-4646-9f4f-17502a0c65df req-40b10a79-721b-4ecf-91fe-9dde266e2a85 service nova] Acquired lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-0ec4c7ae-65db-4646-9f4f-17502a0c65df req-40b10a79-721b-4ecf-91fe-9dde266e2a85 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Refreshing network info cache for port 02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-0ec4c7ae-65db-4646-9f4f-17502a0c65df req-40b10a79-721b-4ecf-91fe-9dde266e2a85 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updated VIF entry in instance network info cache for port 02539ac7-b338-4419-8c36-f8683da00cb5. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-0ec4c7ae-65db-4646-9f4f-17502a0c65df req-40b10a79-721b-4ecf-91fe-9dde266e2a85 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updating instance_info_cache with network_info: [{"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0ec4c7ae-65db-4646-9f4f-17502a0c65df req-40b10a79-721b-4ecf-91fe-9dde266e2a85 service nova] Releasing lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:33 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:52:33 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7978MB free_disk=25.70783233642578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 03f62fe3-a6ce-45bc-a99a-4d134b330c1e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 133007ba-7922-43b9-babc-4e32bd0dcb1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 62224c8d-72a9-449a-ab5b-376197157c3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:52:33 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Creating image(s)
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Ensure instance console log exists: /opt/stack/data/nova/instances/54fa74ec-d37c-4517-8f83-9ea1f23c1cc4/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Start _get_guest_xml network_info=[{"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQcnwRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54fa74ec-d37c-4517-8f83-9ea1f23c1cc4', 'attached_at': '', 'detached_at': '', 'volume_id': '83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'serial': '83e12811-d82a-4e65-a0b1-b4c84ecad9e3'}, 'disk_bus': 'virtio', 'attachment_id': '4dec1446-066c-477f-8ae0-df37c17f37fa', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:52:33 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:52:33 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG os_brick.initiator.connector [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Factory for ISCSI on None {{(pid=74889) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQcnwRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:52:33 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:52:33 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:52:33 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:52:33 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:52:33 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[924d5005-4388-4929-9970-a34e2bbddb7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:52:33 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[867f11f0-f75e-4e46-aebd-2d51245a8b61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3] added
Nov 10 11:52:34 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ddd9c9-c2bb-4966-b9e6-63b4e2cca023]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3189f599-df0d-4eb7-b7cb-7ff69a4ba9eb]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrQcnwRI {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrQcnwRI" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[817f7d9a-8d11-4ef7-84a6-024f29d01c66]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qrQcnwRI'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ba772e-4b61-443d-8010-7beee575e2b7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cc5ce6-cf95-4c9e-b5e1-8ad61da8ea2d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 11:52:34 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 11:52:34 user nova-compute[74889]:  {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:52:34 user nova-compute[74889]: WARNING os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 11:52:34 user nova-compute[74889]: 
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d619cfe9-ce37-4451-9e7b-97c838c67aca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260]
Nov 10 11:52:34 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260] successful.
Nov 10 11:52:34 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[296eec7c-07de-4af9-b730-c831ececf656]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6495d34-8889-4068-8284-5df998153a5c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:52:34 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:52:34 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec9ecb-d003-4bae-ad93-f2f9b84a91c9]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:52:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQcnwRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26666613766363831', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666613766363831', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-868336549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-868336549',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0uHLQXQj7dInSfVC9TaIgqa+9RQkjH42pg0qSxOcSGwGx0kYhgRvc39hCLN0H5L4IYuYHZeUvD0cEK5tcx4IArwdZ7cEmkvJUn/s+QbltOH4DHvllrCcGkdiSwTNa9tg==',key_name='tempest-keypair-27701663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c0db768727f4544865ec53756cf5e4f',ramdisk_id='',reservation_id='r-3vgvinwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1329161327',owner_user_name='tempest-ServerActionsV293TestJSON-1329161327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:52:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82bd448d0c3045aeb1114169f1a952b9',uuid=54fa74ec-d37c-4517-8f83-9ea1f23c1cc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converting VIF {"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.objects.instance [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lazy-loading 'pci_devices' on Instance uuid 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:52:35 user nova-compute[74889]:   <uuid>54fa74ec-d37c-4517-8f83-9ea1f23c1cc4</uuid>
Nov 10 11:52:35 user nova-compute[74889]:   <name>instance-00000007</name>
Nov 10 11:52:35 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:52:35 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:52:35 user nova-compute[74889]:   <metadata>
Nov 10 11:52:35 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:52:35 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:52:35 user nova-compute[74889]:       <nova:name>tempest-ServerActionsV293TestJSON-server-868336549</nova:name>
Nov 10 11:52:35 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:52:33</nova:creationTime>
Nov 10 11:52:35 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:52:35 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:52:35 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:52:35 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:52:35 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:52:35 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:52:35 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:52:35 user nova-compute[74889]:       <nova:owner>
Nov 10 11:52:35 user nova-compute[74889]:         <nova:user uuid="82bd448d0c3045aeb1114169f1a952b9">tempest-ServerActionsV293TestJSON-1329161327-project-member</nova:user>
Nov 10 11:52:35 user nova-compute[74889]:         <nova:project uuid="9c0db768727f4544865ec53756cf5e4f">tempest-ServerActionsV293TestJSON-1329161327</nova:project>
Nov 10 11:52:35 user nova-compute[74889]:       </nova:owner>
Nov 10 11:52:35 user nova-compute[74889]:       <nova:ports>
Nov 10 11:52:35 user nova-compute[74889]:         <nova:port uuid="da93881f-7f2f-401e-8dcd-a881954e3905">
Nov 10 11:52:35 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 11:52:35 user nova-compute[74889]:         </nova:port>
Nov 10 11:52:35 user nova-compute[74889]:       </nova:ports>
Nov 10 11:52:35 user nova-compute[74889]:     </nova:instance>
Nov 10 11:52:35 user nova-compute[74889]:   </metadata>
Nov 10 11:52:35 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:52:35 user nova-compute[74889]:     <system>
Nov 10 11:52:35 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:52:35 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:52:35 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:52:35 user nova-compute[74889]:       <entry name="serial">54fa74ec-d37c-4517-8f83-9ea1f23c1cc4</entry>
Nov 10 11:52:35 user nova-compute[74889]:       <entry name="uuid">54fa74ec-d37c-4517-8f83-9ea1f23c1cc4</entry>
Nov 10 11:52:35 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:52:35 user nova-compute[74889]:     </system>
Nov 10 11:52:35 user nova-compute[74889]:   </sysinfo>
Nov 10 11:52:35 user nova-compute[74889]:   <os>
Nov 10 11:52:35 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:52:35 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:52:35 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:52:35 user nova-compute[74889]:   </os>
Nov 10 11:52:35 user nova-compute[74889]:   <features>
Nov 10 11:52:35 user nova-compute[74889]:     <acpi/>
Nov 10 11:52:35 user nova-compute[74889]:     <apic/>
Nov 10 11:52:35 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:52:35 user nova-compute[74889]:   </features>
Nov 10 11:52:35 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:52:35 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:52:35 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:52:35 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:52:35 user nova-compute[74889]:   </clock>
Nov 10 11:52:35 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:52:35 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:52:35 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:52:35 user nova-compute[74889]:   </cpu>
Nov 10 11:52:35 user nova-compute[74889]:   <devices>
Nov 10 11:52:35 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 11:52:35 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:52:35 user nova-compute[74889]:       <source dev="/dev/sdb"/>
Nov 10 11:52:35 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:52:35 user nova-compute[74889]:       <serial>83e12811-d82a-4e65-a0b1-b4c84ecad9e3</serial>
Nov 10 11:52:35 user nova-compute[74889]:     </disk>
Nov 10 11:52:35 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:52:35 user nova-compute[74889]:       <mac address="fa:16:3e:95:7d:80"/>
Nov 10 11:52:35 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:52:35 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:52:35 user nova-compute[74889]:       <target dev="tapda93881f-7f"/>
Nov 10 11:52:35 user nova-compute[74889]:     </interface>
Nov 10 11:52:35 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:52:35 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/54fa74ec-d37c-4517-8f83-9ea1f23c1cc4/console.log" append="off"/>
Nov 10 11:52:35 user nova-compute[74889]:     </serial>
Nov 10 11:52:35 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:52:35 user nova-compute[74889]:     <video>
Nov 10 11:52:35 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:52:35 user nova-compute[74889]:     </video>
Nov 10 11:52:35 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:52:35 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:52:35 user nova-compute[74889]:     </rng>
Nov 10 11:52:35 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:52:35 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:52:35 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:52:35 user nova-compute[74889]:     </memballoon>
Nov 10 11:52:35 user nova-compute[74889]:   </devices>
Nov 10 11:52:35 user nova-compute[74889]: </domain>
Nov 10 11:52:35 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-868336549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-868336549',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0uHLQXQj7dInSfVC9TaIgqa+9RQkjH42pg0qSxOcSGwGx0kYhgRvc39hCLN0H5L4IYuYHZeUvD0cEK5tcx4IArwdZ7cEmkvJUn/s+QbltOH4DHvllrCcGkdiSwTNa9tg==',key_name='tempest-keypair-27701663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c0db768727f4544865ec53756cf5e4f',ramdisk_id='',reservation_id='r-3vgvinwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1329161327',owner_user_name='tempest-ServerActionsV293TestJSON-1329161327-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:52:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82bd448d0c3045aeb1114169f1a952b9',uuid=54fa74ec-d37c-4517-8f83-9ea1f23c1cc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converting VIF {"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG os_vif [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f5f6a4b-f0e5-5761-8d74-a7fbfed44564', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda93881f-7f, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda93881f-7f, col_values=(('qos', UUID('77b59e9b-a695-48be-ac3f-88355e6f6e09')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda93881f-7f, col_values=(('external_ids', {'iface-id': 'da93881f-7f2f-401e-8dcd-a881954e3905', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:7d:80', 'vm-uuid': '54fa74ec-d37c-4517-8f83-9ea1f23c1cc4'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:35 user nova-compute[74889]: INFO os_vif [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f')
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:52:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] No VIF found with MAC fa:16:3e:95:7d:80, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updating instance_info_cache with network_info: [{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-e83cb951-c4eb-4e4d-a849-1416be2cb061 req-3761bf4c-be42-41fb-bd76-dfbff2c7bdc5 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e83cb951-c4eb-4e4d-a849-1416be2cb061 req-3761bf4c-be42-41fb-bd76-dfbff2c7bdc5 service nova] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e83cb951-c4eb-4e4d-a849-1416be2cb061 req-3761bf4c-be42-41fb-bd76-dfbff2c7bdc5 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e83cb951-c4eb-4e4d-a849-1416be2cb061 req-3761bf4c-be42-41fb-bd76-dfbff2c7bdc5 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-e83cb951-c4eb-4e4d-a849-1416be2cb061 req-3761bf4c-be42-41fb-bd76-dfbff2c7bdc5 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] No waiting events found dispatching network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:52:37 user nova-compute[74889]: WARNING nova.compute.manager [req-e83cb951-c4eb-4e4d-a849-1416be2cb061 req-3761bf4c-be42-41fb-bd76-dfbff2c7bdc5 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received unexpected event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 for instance with vm_state building and task_state spawning.
Nov 10 11:52:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.101s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:38 user nova-compute[74889]: INFO nova.compute.manager [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Attaching volume 54c47476-ac7b-496c-87b5-70b24843f2de to /dev/vdb
Nov 10 11:52:38 user nova-compute[74889]: DEBUG os_brick.utils [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6be60d-9ed3-4d14-80c7-0e3ed0f8e6fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1667c54f-cd83-4db9-b008-47377df38c32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[365930f6-165d-409c-bf7f-77aee7e0c8de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9edf8c-c465-467d-bc3f-e2dff9655928]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:52:38 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:52:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddcccef-b48a-472b-8018-4490cbbed452]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG os_brick.utils [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updating existing volume attachment record: dd3a9c73-0488-4d59-92b0-600a74bcfcbb {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:52:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-88bd3697-20f1-4a80-8cac-9f0a5ce1c37f req-734c1bb9-76a1-4eb0-acd5-aa3891749a56 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-88bd3697-20f1-4a80-8cac-9f0a5ce1c37f req-734c1bb9-76a1-4eb0-acd5-aa3891749a56 service nova] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-88bd3697-20f1-4a80-8cac-9f0a5ce1c37f req-734c1bb9-76a1-4eb0-acd5-aa3891749a56 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-88bd3697-20f1-4a80-8cac-9f0a5ce1c37f req-734c1bb9-76a1-4eb0-acd5-aa3891749a56 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-88bd3697-20f1-4a80-8cac-9f0a5ce1c37f req-734c1bb9-76a1-4eb0-acd5-aa3891749a56 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] No waiting events found dispatching network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:52:39 user nova-compute[74889]: WARNING nova.compute.manager [req-88bd3697-20f1-4a80-8cac-9f0a5ce1c37f req-734c1bb9-76a1-4eb0-acd5-aa3891749a56 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received unexpected event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 for instance with vm_state building and task_state spawning.
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:52:39 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Instance spawned successfully.
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:52:39 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:52:39 user nova-compute[74889]: INFO nova.compute.manager [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 10 11:52:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:52:39 user nova-compute[74889]: INFO nova.compute.manager [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Took 34.24 seconds to build instance.
Nov 10 11:52:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c02e0353-ceb6-4759-9b7e-3b497cd8b94e tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.358s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-308a5ac3-a51a-4f1d-98d1-e2fdaf19c312 req-5a1de2ba-b749-4e66-bda4-5fdbb749e566 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received event network-changed-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:52:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-308a5ac3-a51a-4f1d-98d1-e2fdaf19c312 req-5a1de2ba-b749-4e66-bda4-5fdbb749e566 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Refreshing instance network info cache due to event network-changed-9c692175-8e5b-4186-b654-169463411093. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:52:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-308a5ac3-a51a-4f1d-98d1-e2fdaf19c312 req-5a1de2ba-b749-4e66-bda4-5fdbb749e566 service nova] Acquiring lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:52:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-308a5ac3-a51a-4f1d-98d1-e2fdaf19c312 req-5a1de2ba-b749-4e66-bda4-5fdbb749e566 service nova] Acquired lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:52:45 user nova-compute[74889]: DEBUG nova.network.neutron [req-308a5ac3-a51a-4f1d-98d1-e2fdaf19c312 req-5a1de2ba-b749-4e66-bda4-5fdbb749e566 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Refreshing network info cache for port 9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:52:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-308a5ac3-a51a-4f1d-98d1-e2fdaf19c312 req-5a1de2ba-b749-4e66-bda4-5fdbb749e566 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Updated VIF entry in instance network info cache for port 9c692175-8e5b-4186-b654-169463411093. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:52:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-308a5ac3-a51a-4f1d-98d1-e2fdaf19c312 req-5a1de2ba-b749-4e66-bda4-5fdbb749e566 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Updating instance_info_cache with network_info: [{"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:52:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-308a5ac3-a51a-4f1d-98d1-e2fdaf19c312 req-5a1de2ba-b749-4e66-bda4-5fdbb749e566 service nova] Releasing lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:52:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zFOrSdwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:52:56 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:52:56 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:52:56 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[672e2f1a-bc79-4e3f-816c-e276314d9109]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:52:56 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[79afefe1-a13b-43c2-8675-e6886ee372aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65] added
Nov 10 11:52:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[699c9c70-75ef-4dde-b2a2-4888e48a3ea2]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[901057ef-8a78-4c81-a93d-8e4f589aa3ce]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zFOrSdwH {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zFOrSdwH" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc30fa9a-dc55-45e2-9345-4c8a2e31f1ee]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zFOrSdwH'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a61fcc-b7a6-4095-aec3-93ac04e96c75]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca8bb86-f624-42a1-8079-8172824227ea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:52:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:52:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb28108-195a-463c-b099-c559383a4be9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65, portal: 172.16.0.220,3260]
Nov 10 11:52:56 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65, portal: 172.16.0.220,3260] successful.
Nov 10 11:52:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a2acd9-70a2-4119-8238-ec9a56c7ad62]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f934636e-b9a2-42f7-9f1c-f197d17a5f79]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:52:56 user nova-compute[74889]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 (non-flash)
Nov 10 11:52:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:52:56 user nova-compute[74889]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 (non-flash)
Nov 10 11:52:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ef1c25-1e72-412e-bfe0-0db4ee07ce01]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:52:56 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:52:57 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:52:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zFOrSdwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:52:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:52:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26230306536353661', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:52:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26230306536353661', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:52:57 user nova-compute[74889]: DEBUG nova.objects.instance [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lazy-loading 'flavor' on Instance uuid 03f62fe3-a6ce-45bc-a99a-4d134b330c1e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:52:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 11:52:57 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:52:57 user nova-compute[74889]:   <source dev="/dev/sdc"/>
Nov 10 11:52:57 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:52:57 user nova-compute[74889]:   <serial>ef50dbbb-659e-4236-be66-aebdc8433a65</serial>
Nov 10 11:52:57 user nova-compute[74889]: </disk>
Nov 10 11:52:57 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 11:52:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:52:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:52:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] No VIF found with MAC fa:16:3e:bc:04:5b, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:52:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5c98a9aa-ed8b-4b17-b323-88e948b8208b tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.545s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:59 user nova-compute[74889]: INFO nova.compute.manager [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Terminating instance
Nov 10 11:52:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-d1d5ac56-6701-4dab-a077-bbfd7bfd3ea7 req-9644940a-793e-4a30-a6c7-a60118e656ee service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received event network-vif-unplugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d1d5ac56-6701-4dab-a077-bbfd7bfd3ea7 req-9644940a-793e-4a30-a6c7-a60118e656ee service nova] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d1d5ac56-6701-4dab-a077-bbfd7bfd3ea7 req-9644940a-793e-4a30-a6c7-a60118e656ee service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d1d5ac56-6701-4dab-a077-bbfd7bfd3ea7 req-9644940a-793e-4a30-a6c7-a60118e656ee service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-d1d5ac56-6701-4dab-a077-bbfd7bfd3ea7 req-9644940a-793e-4a30-a6c7-a60118e656ee service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] No waiting events found dispatching network-vif-unplugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-d1d5ac56-6701-4dab-a077-bbfd7bfd3ea7 req-9644940a-793e-4a30-a6c7-a60118e656ee service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received event network-vif-unplugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:52:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Instance destroyed successfully.
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.objects.instance [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lazy-loading 'resources' on Instance uuid 03f62fe3-a6ce-45bc-a99a-4d134b330c1e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-333454560',display_name='tempest-DeleteServersTestJSON-server-333454560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-333454560',id=1,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:50:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51bcafc15ed24037a90c2e9dc1c645e6',ramdisk_id='',reservation_id='r-nfbpgucr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-961605254',owner_user_name='tempest-DeleteServersTestJSON-961605254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:50:50Z,user_data=None,user_id='89dc402d78ab447f86cce065422fb9cb',uuid=03f62fe3-a6ce-45bc-a99a-4d134b330c1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Converting VIF {"id": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "address": "fa:16:3e:bc:04:5b", "network": {"id": "a5e8d5fc-2b28-4618-b64e-1d56ca67367f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1249669616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51bcafc15ed24037a90c2e9dc1c645e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65d5e17-91", "ovs_interfaceid": "e65d5e17-91a1-467d-a9bf-b7e38ca34af4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:5b,bridge_name='br-int',has_traffic_filtering=True,id=e65d5e17-91a1-467d-a9bf-b7e38ca34af4,network=Network(a5e8d5fc-2b28-4618-b64e-1d56ca67367f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65d5e17-91') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_vif [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:5b,bridge_name='br-int',has_traffic_filtering=True,id=e65d5e17-91a1-467d-a9bf-b7e38ca34af4,network=Network(a5e8d5fc-2b28-4618-b64e-1d56ca67367f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65d5e17-91') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape65d5e17-91, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f0eed2c-3299-4850-a2ba-c11eb42b5785) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:00 user nova-compute[74889]: INFO os_vif [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:04:5b,bridge_name='br-int',has_traffic_filtering=True,id=e65d5e17-91a1-467d-a9bf-b7e38ca34af4,network=Network(a5e8d5fc-2b28-4618-b64e-1d56ca67367f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65d5e17-91')
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zFOrSdwH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:53:00 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f01c6a-eef8-4a6e-a871-19d545270c80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:53:00 user nova-compute[74889]: No targets found.
Nov 10 11:53:00 user nova-compute[74889]: iSNS:
Nov 10 11:53:00 user nova-compute[74889]: No targets found.
Nov 10 11:53:00 user nova-compute[74889]: STATIC:
Nov 10 11:53:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65
Nov 10 11:53:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:53:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:53:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3
Nov 10 11:53:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:53:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:53:00 user nova-compute[74889]: FIRMWARE:
Nov 10 11:53:00 user nova-compute[74889]: No targets found.
Nov 10 11:53:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:53:00 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:53:00 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8a1b48-1190-45f5-a077-2a555d751f5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[31796cad-eb5a-4879-affe-3a771a253831]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:00 user nova-compute[74889]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 (non-flash)
Nov 10 11:53:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:00 user nova-compute[74889]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 (non-flash)
Nov 10 11:53:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398206c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65'): ({'sdc'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Removing single pathed devices sdc {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d38bfb-f738-4c4d-bb20-743342c51782]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e2c08f-e152-44b9-934b-fd4365a40264]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Flushing IO for device /dev/sdc {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8a6678-db75-49f3-9bbb-7d0289532739]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[974806cd-54f2-48ff-a6ad-f9c34fd89e9e]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[550c33e6-c5c2-4f38-bc77-521ea73ea619]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf11004-caa8-4633-b042-972ddccec257]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65, portal: 172.16.0.220,3260]
Nov 10 11:53:00 user nova-compute[74889]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65, portal: 172.16.0.220,3260] successful.
Nov 10 11:53:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef50dbbb-659e-4236-be66-aebdc8433a65 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6994f4db-aeb8-4270-91a1-e47815de8e82]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] <== disconnect_volume: return (429ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:53:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Deleting instance files /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e_del
Nov 10 11:53:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Deletion of /opt/stack/data/nova/instances/03f62fe3-a6ce-45bc-a99a-4d134b330c1e_del complete
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-632e3505-8dbd-47f9-9c02-05dde1733617 req-0638455d-23fc-4415-aab8-52733e99d354 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received event network-changed-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-632e3505-8dbd-47f9-9c02-05dde1733617 req-0638455d-23fc-4415-aab8-52733e99d354 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Refreshing instance network info cache due to event network-changed-84a0b161-daed-42f6-8f9f-61cacf7c4798. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-632e3505-8dbd-47f9-9c02-05dde1733617 req-0638455d-23fc-4415-aab8-52733e99d354 service nova] Acquiring lock "refresh_cache-330f6b5b-9e60-42bf-be67-981a13e29ef4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-632e3505-8dbd-47f9-9c02-05dde1733617 req-0638455d-23fc-4415-aab8-52733e99d354 service nova] Acquired lock "refresh_cache-330f6b5b-9e60-42bf-be67-981a13e29ef4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.network.neutron [req-632e3505-8dbd-47f9-9c02-05dde1733617 req-0638455d-23fc-4415-aab8-52733e99d354 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Refreshing network info cache for port 84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74889) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 10 11:53:00 user nova-compute[74889]: INFO nova.virt.libvirt.host [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] UEFI support detected
Nov 10 11:53:00 user nova-compute[74889]: INFO nova.compute.manager [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Took 1.55 seconds to destroy the instance on the hypervisor.
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Acquiring lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lazy-loading 'flavor' on Instance uuid 330f6b5b-9e60-42bf-be67-981a13e29ef4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Acquiring lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:01 user nova-compute[74889]: INFO nova.compute.manager [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Attaching volume a6bc0128-c663-4780-9019-7b421d51ca8d to /dev/vdb
Nov 10 11:53:01 user nova-compute[74889]: DEBUG os_brick.utils [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8a0fa6-99f0-498b-81e0-a58ceb8684c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7c87e0-f7ea-45c6-a47a-ec9f809359e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a3a3f1-8967-4e70-b0e0-10bdd4bd5593]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc14d9c-aeb1-4ef2-9cb7-d864f328580a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:53:01 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[428f18a8-dcc2-4a81-af6d-432f6c01737a]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG os_brick.utils [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Updating existing volume attachment record: a77107a2-108e-40fa-9491-8e12bbd08e2d {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG nova.network.neutron [req-632e3505-8dbd-47f9-9c02-05dde1733617 req-0638455d-23fc-4415-aab8-52733e99d354 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Updated VIF entry in instance network info cache for port 84a0b161-daed-42f6-8f9f-61cacf7c4798. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG nova.network.neutron [req-632e3505-8dbd-47f9-9c02-05dde1733617 req-0638455d-23fc-4415-aab8-52733e99d354 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Updating instance_info_cache with network_info: [{"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] No waiting events found dispatching network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:53:01 user nova-compute[74889]: WARNING nova.compute.manager [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received unexpected event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 for instance with vm_state active and task_state deleting.
Nov 10 11:53:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] No waiting events found dispatching network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:53:01 user nova-compute[74889]: WARNING nova.compute.manager [req-51588557-5a8b-4c61-9925-ebd02b427254 req-3e663385-3376-43fe-a65c-de236ca1ed82 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received unexpected event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 for instance with vm_state active and task_state deleting.
Nov 10 11:53:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-632e3505-8dbd-47f9-9c02-05dde1733617 req-0638455d-23fc-4415-aab8-52733e99d354 service nova] Releasing lock "refresh_cache-330f6b5b-9e60-42bf-be67-981a13e29ef4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:53:02 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:53:02 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Took 1.64 seconds to deallocate network for instance.
Nov 10 11:53:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:02 user nova-compute[74889]: DEBUG nova.objects.instance [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lazy-loading 'flavor' on Instance uuid 62224c8d-72a9-449a-ab5b-376197157c3e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:53:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.154s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] No waiting events found dispatching network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:53:03 user nova-compute[74889]: WARNING nova.compute.manager [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received unexpected event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 for instance with vm_state active and task_state deleting.
Nov 10 11:53:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received event network-changed-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Refreshing instance network info cache due to event network-changed-7d5ab299-1af9-4966-ba6d-12e8ebe7087b. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:53:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] Acquiring lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:53:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] Acquired lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:53:03 user nova-compute[74889]: DEBUG nova.network.neutron [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Refreshing network info cache for port 7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:53:04 user nova-compute[74889]: DEBUG nova.network.neutron [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Updated VIF entry in instance network info cache for port 7d5ab299-1af9-4966-ba6d-12e8ebe7087b. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:53:04 user nova-compute[74889]: DEBUG nova.network.neutron [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Updating instance_info_cache with network_info: [{"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:53:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] Releasing lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:53:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] Acquiring lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] No waiting events found dispatching network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:53:04 user nova-compute[74889]: WARNING nova.compute.manager [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received unexpected event network-vif-plugged-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 for instance with vm_state active and task_state deleting.
Nov 10 11:53:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-b444f2ab-342f-4848-b2e8-3c39d33e86a1 req-601f3ee2-b618-4e52-9c20-cb888cb75f42 service nova] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Received event network-vif-deleted-e65d5e17-91a1-467d-a9bf-b7e38ca34af4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:05 user nova-compute[74889]: INFO nova.compute.manager [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] [instance: 03f62fe3-a6ce-45bc-a99a-4d134b330c1e] Took 3.23 seconds to detach 1 volumes for instance.
Nov 10 11:53:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:06 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:53:06 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:53:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:06 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Deleted allocations for instance 03f62fe3-a6ce-45bc-a99a-4d134b330c1e
Nov 10 11:53:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-de0d925d-aa12-4a56-ae45-97a514c5f023 tempest-DeleteServersTestJSON-961605254 tempest-DeleteServersTestJSON-961605254-project-member] Lock "03f62fe3-a6ce-45bc-a99a-4d134b330c1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.139s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:06 user nova-compute[74889]: INFO nova.compute.manager [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Attaching volume a6f39e4b-de0e-4f77-8ad4-3c61538b2707 to /dev/vdb
Nov 10 11:53:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:06 user nova-compute[74889]: DEBUG nova.objects.instance [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lazy-loading 'flavor' on Instance uuid 133007ba-7922-43b9-babc-4e32bd0dcb1f {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:53:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:53:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJRCNbgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:53:06 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:53:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:53:07 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:53:07 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e19df1f-6d7e-4ffa-a6db-fd12a7e470d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:53:07 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0495db-e23a-4107-be42-f4b2f6fbb298]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de] added
Nov 10 11:53:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[15323409-5efa-4dbd-92fe-02fcd79f54d7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa0fe6d-fd36-4aa9-98ac-38099d021f8c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJRCNbgu {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJRCNbgu" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9d858c-9646-4dfc-883d-d22b36aef25e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fJRCNbgu'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3165bd-7328-4a50-b729-12dbbed91e71]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab295c5e-c61f-46b6-8020-9d3599c08978]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.utils [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[59675d98-89a3-404c-8da6-25bb1617a040]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aef050c-fbb2-4375-8de8-44783d8af16d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a679e134-67d0-42ef-bd02-c8773f927e2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260]
Nov 10 11:53:07 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260] successful.
Nov 10 11:53:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d0a6e-586f-4131-a1ea-d6ca6e52fb00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8800b9f2-3295-4af4-98b9-9994f2c7d0da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1539831e-2175-45cc-a726-f2b0f9c59423]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:53:07 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[478a5d58-48b9-4a11-bd71-0855f67138e0]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.utils [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Updating existing volume attachment record: 393c9f63-78e7-4783-8a2a-dad8347fb476 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3d5404-09d0-4ee2-96ff-e055a4724b8d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:07 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:07 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:07 user nova-compute[74889]: INFO nova.compute.manager [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Attaching volume 674c6452-a546-4308-827a-b9aff0525e45 to /dev/sdc
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e200c3-1a3f-48a0-9d56-f153cbddd392]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJRCNbgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.utils [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafe643f-8de9-47e8-8fcb-bac8aa242395]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e257f76-7f5d-4ab2-8061-1df1a04febb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d73e957-8d1d-4352-8e9a-6d138c52032c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[612df6ae-0231-4cb4-b9b4-4bccaac76266]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:53:07 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:53:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb2f128-f8ec-441e-bdf9-122494af1246]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG os_brick.utils [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:53:07 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Updating existing volume attachment record: b86316e8-9743-474b-b866-fec75a70843b {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:53:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:53:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== connect_volume: return (1475ms) {'type': 'block', 'scsi_wwn': '23635333738353738', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:53:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635333738353738', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:53:08 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:53:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 11:53:08 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:53:08 user nova-compute[74889]:   <source dev="/dev/sdc"/>
Nov 10 11:53:08 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:53:08 user nova-compute[74889]:   <serial>54c47476-ac7b-496c-87b5-70b24843f2de</serial>
Nov 10 11:53:08 user nova-compute[74889]: </disk>
Nov 10 11:53:08 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 11:53:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:53:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:53:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No VIF found with MAC fa:16:3e:84:97:e7, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:53:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qleDMdKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:53:28 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:53:28 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:53:28 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea22bc8-f63c-4d48-9597-d68c2a43709b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:53:28 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cfdbf5-77c7-4e6e-8150-acc69b699b53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d] added
Nov 10 11:53:28 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcf01d5-585e-49e9-a1ca-83b65920eaf5]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb02572-35bd-44db-908b-0f8a7cc5f3f1]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qleDMdKN {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qleDMdKN" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55fb659-5772-4172-8d79-b4c45a2f2002]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qleDMdKN'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0dffd6-2c68-45e4-b5e9-7f95eb8e82e1]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de6dc3d-ce1a-4860-ad1a-d5da11bfcea0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:28 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:28 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:28 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:28 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e961af-9f41-4b82-964d-1f42572dcfce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d, portal: 172.16.0.220,3260]
Nov 10 11:53:28 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d, portal: 172.16.0.220,3260] successful.
Nov 10 11:53:28 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10f4704-b449-40e8-bd56-0582ef3a3928]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d643c3c2-e71e-427c-8bca-c35c96751e6d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:28 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:28 user nova-compute[74889]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d (non-flash)
Nov 10 11:53:28 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:28 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:28 user nova-compute[74889]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d (non-flash)
Nov 10 11:53:28 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6f2d02-d90b-4b83-9265-bd2596c312b6]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:53:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e2f14bf5-b09c-46ef-8880-b3ca2eb5348d tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.087s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:29 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:53:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qleDMdKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:53:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:53:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23730383031373632', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:53:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730383031373632', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:53:29 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lazy-loading 'flavor' on Instance uuid 330f6b5b-9e60-42bf-be67-981a13e29ef4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:53:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] attach device xml: <disk type="block" device="disk">
Nov 10 11:53:29 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:53:29 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:53:29 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:53:29 user nova-compute[74889]:   <serial>a6bc0128-c663-4780-9019-7b421d51ca8d</serial>
Nov 10 11:53:29 user nova-compute[74889]: </disk>
Nov 10 11:53:29 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] No VIF found with MAC fa:16:3e:bc:80:af, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ddfc18e6-7f54-40f5-a52f-0cf25f1b1004 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.043s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1706aadf-eab5-4811-b158-65ae6d3361b8 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1706aadf-eab5-4811-b158-65ae6d3361b8 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1706aadf-eab5-4811-b158-65ae6d3361b8 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1706aadf-eab5-4811-b158-65ae6d3361b8 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74889) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1706aadf-eab5-4811-b158-65ae6d3361b8 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-52d37c8d-2c27-4d52-85e8-34168fbe0296 req-9ca131ab-005f-4f6e-883d-07dc2daa1056 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-unplugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-52d37c8d-2c27-4d52-85e8-34168fbe0296 req-9ca131ab-005f-4f6e-883d-07dc2daa1056 service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-52d37c8d-2c27-4d52-85e8-34168fbe0296 req-9ca131ab-005f-4f6e-883d-07dc2daa1056 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-52d37c8d-2c27-4d52-85e8-34168fbe0296 req-9ca131ab-005f-4f6e-883d-07dc2daa1056 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-52d37c8d-2c27-4d52-85e8-34168fbe0296 req-9ca131ab-005f-4f6e-883d-07dc2daa1056 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-unplugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:53:30 user nova-compute[74889]: WARNING nova.compute.manager [req-52d37c8d-2c27-4d52-85e8-34168fbe0296 req-9ca131ab-005f-4f6e-883d-07dc2daa1056 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-unplugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state active and task_state powering-off.
Nov 10 11:53:31 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance destroyed successfully.
Nov 10 11:53:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1706aadf-eab5-4811-b158-65ae6d3361b8 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:53:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1706aadf-eab5-4811-b158-65ae6d3361b8 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.150s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47e86029-9bd0-4e61-bf55-cc6c16ede066 tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] volume_snapshot_create: create_info: {'snapshot_id': '52703a7a-0f70-4f02-b77e-d48aee2f4ba2', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74889) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 10 11:53:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47e86029-9bd0-4e61-bf55-cc6c16ede066 tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] snap xml: <domainsnapshot>
Nov 10 11:53:31 user nova-compute[74889]:   <disks>
Nov 10 11:53:31 user nova-compute[74889]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 10 11:53:31 user nova-compute[74889]:       <source file="/dev/new_file"/>
Nov 10 11:53:31 user nova-compute[74889]:     </disk>
Nov 10 11:53:31 user nova-compute[74889]:     <disk name="vda" snapshot="no"/>
Nov 10 11:53:31 user nova-compute[74889]:   </disks>
Nov 10 11:53:31 user nova-compute[74889]: </domainsnapshot>
Nov 10 11:53:31 user nova-compute[74889]:  {{(pid=74889) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 10 11:53:31 user nova-compute[74889]: DEBUG nova.objects.instance [None req-47e86029-9bd0-4e61-bf55-cc6c16ede066 tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] Lazy-loading 'system_metadata' on Instance uuid 330f6b5b-9e60-42bf-be67-981a13e29ef4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:53:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-15540ced-6100-41c1-849b-0c53b615ffdb tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] volume_snapshot_delete: delete_info: {'volume_id': 'a6bc0128-c663-4780-9019-7b421d51ca8d'} {{(pid=74889) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [None req-15540ced-6100-41c1-849b-0c53b615ffdb tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     if delete_info['type'] != 'qcow2':
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] KeyError: 'type'
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] 
Nov 10 11:53:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-47e86029-9bd0-4e61-bf55-cc6c16ede066 tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [None req-47e86029-9bd0-4e61-bf55-cc6c16ede066 tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     rv = execute(f, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     six.reraise(c, e, tb)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     raise value
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     rv = meth(*args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [None req-47e86029-9bd0-4e61-bf55-cc6c16ede066 tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     self._volume_snapshot_create(context, instance, guest,
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     rv = execute(f, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     six.reraise(c, e, tb)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     raise value
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     rv = meth(*args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [None req-15540ced-6100-41c1-849b-0c53b615ffdb tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-862539b4-11c1-4696-9ba1-591b6ed3082a)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver 
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server [None req-15540ced-6100-41c1-849b-0c53b615ffdb tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] Exception during message handling: KeyError: 'type'
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver [None req-47e86029-9bd0-4e61-bf55-cc6c16ede066 tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 52703a7a-0f70-4f02-b77e-d48aee2f4ba2 could not be found.
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     raise value
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 52703a7a-0f70-4f02-b77e-d48aee2f4ba2 could not be found. (HTTP 404) (Request-ID: req-e1d56f35-9ce0-446e-a6f9-4c9902f9af89)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver 
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 52703a7a-0f70-4f02-b77e-d48aee2f4ba2 could not be found.
Nov 10 11:53:32 user nova-compute[74889]: ERROR nova.virt.libvirt.driver 
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server [None req-47e86029-9bd0-4e61-bf55-cc6c16ede066 tempest-VolumesAssistedSnapshotsTest-463940674 tempest-VolumesAssistedSnapshotsTest-463940674-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise value
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 11:53:32 user nova-compute[74889]: ERROR oslo_messaging.rpc.server 
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Acquiring lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:32 user nova-compute[74889]: INFO nova.compute.manager [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Detaching volume a6bc0128-c663-4780-9019-7b421d51ca8d
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:32 user nova-compute[74889]: INFO nova.virt.block_device [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Attempting to driver detach volume a6bc0128-c663-4780-9019-7b421d51ca8d from mountpoint /dev/vdb
Nov 10 11:53:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Attempting to detach device vdb from instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 11:53:32 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:53:32 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:53:32 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:53:32 user nova-compute[74889]:   <serial>a6bc0128-c663-4780-9019-7b421d51ca8d</serial>
Nov 10 11:53:32 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 11:53:32 user nova-compute[74889]: </disk>
Nov 10 11:53:32 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:53:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Successfully detached device vdb from instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 from the persistent domain config.
Nov 10 11:53:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 11:53:32 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:53:32 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:53:32 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:53:32 user nova-compute[74889]:   <serial>a6bc0128-c663-4780-9019-7b421d51ca8d</serial>
Nov 10 11:53:32 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 11:53:32 user nova-compute[74889]: </disk>
Nov 10 11:53:32 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-3da5f24b-8bca-4d76-a76c-1f963f8166ab req-5bf8adb5-c72e-4ec9-aabc-38acc6dfbdba service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3da5f24b-8bca-4d76-a76c-1f963f8166ab req-5bf8adb5-c72e-4ec9-aabc-38acc6dfbdba service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3da5f24b-8bca-4d76-a76c-1f963f8166ab req-5bf8adb5-c72e-4ec9-aabc-38acc6dfbdba service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3da5f24b-8bca-4d76-a76c-1f963f8166ab req-5bf8adb5-c72e-4ec9-aabc-38acc6dfbdba service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-3da5f24b-8bca-4d76-a76c-1f963f8166ab req-5bf8adb5-c72e-4ec9-aabc-38acc6dfbdba service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:53:32 user nova-compute[74889]: WARNING nova.compute.manager [req-3da5f24b-8bca-4d76-a76c-1f963f8166ab req-5bf8adb5-c72e-4ec9-aabc-38acc6dfbdba service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state stopped and task_state None.
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:53:34 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:53:34 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8293MB free_disk=25.72198486328125GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 133007ba-7922-43b9-babc-4e32bd0dcb1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 62224c8d-72a9-449a-ab5b-376197157c3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:53:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:53:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:53:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:53:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:53:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:53:36 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 11:53:37 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updating instance_info_cache with network_info: [{"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:53:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:53:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 11:53:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:53:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:53:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:53:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:53:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:53:38 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:53:39 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:53:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 11:53:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 11:53:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 11:53:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:53 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 is timed out.
Nov 10 11:53:53 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Successfully detached device vdb from instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 from the live domain config.
Nov 10 11:53:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qleDMdKN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:53:53 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93a329f-62c9-498a-9694-f77ca93d5e75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:53:53 user nova-compute[74889]: No targets found.
Nov 10 11:53:53 user nova-compute[74889]: iSNS:
Nov 10 11:53:53 user nova-compute[74889]: No targets found.
Nov 10 11:53:53 user nova-compute[74889]: STATIC:
Nov 10 11:53:53 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:53:53 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:53:53 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:53:53 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d
Nov 10 11:53:53 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:53:53 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:53:53 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3
Nov 10 11:53:53 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:53:53 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:53:53 user nova-compute[74889]: FIRMWARE:
Nov 10 11:53:53 user nova-compute[74889]: No targets found.
Nov 10 11:53:53 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:53:53 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:53:53 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9964c323-19da-485e-baf9-07f06a18fa2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cdc8b3-555b-4c1e-9b76-48edc4b97aba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:53 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:53 user nova-compute[74889]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d (non-flash)
Nov 10 11:53:53 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:53 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:53 user nova-compute[74889]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d (non-flash)
Nov 10 11:53:53 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398226b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d90c4cd-cc50-437e-832e-61b5d8401de5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c469875-7324-4b55-9367-d32f888166c2]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d1c542-cf32-40c0-b677-a803a2ee9f64]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c015b36-931a-4ccf-92a5-20651d2505b0]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f9d011-f3af-427a-a95a-ccfe7ca9a788]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5902a9d3-77df-4723-a92f-5aa60fad7d4d]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d, portal: 172.16.0.220,3260]
Nov 10 11:53:53 user nova-compute[74889]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d, portal: 172.16.0.220,3260] successful.
Nov 10 11:53:53 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6bc0128-c663-4780-9019-7b421d51ca8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7975632b-bc12-4a4d-b801-279521831332]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] <== disconnect_volume: return (338ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:53:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:53:54 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lazy-loading 'flavor' on Instance uuid 330f6b5b-9e60-42bf-be67-981a13e29ef4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:53:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9252340b-eafe-4d53-ad7a-b3bd370370a0 tempest-VolumesAssistedSnapshotsTest-1026146003 tempest-VolumesAssistedSnapshotsTest-1026146003-project-admin] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.333s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjAtDHYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:53:55 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:53:55 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:53:55 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ac681f-4676-4968-ab46-446ea7041dd4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:53:55 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30c3d69-15c6-457b-bee5-964cf6a621bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707] added
Nov 10 11:53:55 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da12e09-5689-4be5-b448-352d6a7812c2]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de23a1-6a53-404b-9209-b4f2a4200592]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjAtDHYU {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjAtDHYU" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dd6508-8249-4ec6-a1a2-375b1017991d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zjAtDHYU'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.volume.cinder [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Update attachment failed for attachment b86316e8-9743-474b-b866-fec75a70843b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6f36bef-4e75-4cac-9bc5-4f50083a43aa) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6f36bef-4e75-4cac-9bc5-4f50083a43aa)
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[531032eb-0749-4251-ac19-f5c766a551ae]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Failed to attach 674c6452-a546-4308-827a-b9aff0525e45 at /dev/sdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6f36bef-4e75-4cac-9bc5-4f50083a43aa)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Traceback (most recent call last):
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     self._do_attach(context, instance, volume, volume_api,
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     self._volume_attach(context, volume, connector, instance,
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     connection_info = volume_api.attachment_update(
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     res = method(self, ctx, *args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     with excutils.save_and_reraise_exception():
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     self.force_reraise()
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     raise self.value
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     return method.func(obj, *args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     resp = self._update('/attachments/%s' % id, body)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     return self.request(url, method, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f]     raise exceptions.from_response(resp, body)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6f36bef-4e75-4cac-9bc5-4f50083a43aa)
Nov 10 11:53:55 user nova-compute[74889]: ERROR nova.compute.manager [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] 
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ffb6c5-633f-47c3-a822-a613ec465d35]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:55 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:55 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:55 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:55 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3135d2b4-a52a-43be-9e6c-dfee46b2108c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260]
Nov 10 11:53:55 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260] successful.
Nov 10 11:53:55 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcecef6-fef5-41a8-b7cb-e672fb8ed709]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 48.145s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6809107-cc67-4b2c-9382-85de64b7b469]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:55 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:55 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:53:55 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:55 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:55 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:53:55 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d1d89b-81a5-4fed-889a-7a93d7de39b1]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:53:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjAtDHYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server [None req-3b7a8640-7e74-4b4d-9df4-ea27eed15aad tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6f36bef-4e75-4cac-9bc5-4f50083a43aa)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-c6f36bef-4e75-4cac-9bc5-4f50083a43aa)
Nov 10 11:53:55 user nova-compute[74889]: ERROR oslo_messaging.rpc.server 
Nov 10 11:53:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:53:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26663633830353431', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:53:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663633830353431', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:53:56 user nova-compute[74889]: DEBUG nova.objects.instance [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lazy-loading 'flavor' on Instance uuid 62224c8d-72a9-449a-ab5b-376197157c3e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:53:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 11:53:56 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:53:56 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:53:56 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:53:56 user nova-compute[74889]:   <serial>a6f39e4b-de0e-4f77-8ad4-3c61538b2707</serial>
Nov 10 11:53:56 user nova-compute[74889]: </disk>
Nov 10 11:53:56 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 11:53:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-ee649d4c-2f1d-4f3d-ad1d-57a2cd3163ed req-f333aebf-086a-4efc-abb7-3ac3d87118b4 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-changed-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-ee649d4c-2f1d-4f3d-ad1d-57a2cd3163ed req-f333aebf-086a-4efc-abb7-3ac3d87118b4 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Refreshing instance network info cache due to event network-changed-da93881f-7f2f-401e-8dcd-a881954e3905. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:53:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ee649d4c-2f1d-4f3d-ad1d-57a2cd3163ed req-f333aebf-086a-4efc-abb7-3ac3d87118b4 service nova] Acquiring lock "refresh_cache-54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:53:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ee649d4c-2f1d-4f3d-ad1d-57a2cd3163ed req-f333aebf-086a-4efc-abb7-3ac3d87118b4 service nova] Acquired lock "refresh_cache-54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:53:56 user nova-compute[74889]: DEBUG nova.network.neutron [req-ee649d4c-2f1d-4f3d-ad1d-57a2cd3163ed req-f333aebf-086a-4efc-abb7-3ac3d87118b4 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Refreshing network info cache for port da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:53:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:53:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:53:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] No VIF found with MAC fa:16:3e:4e:fb:1d, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:53:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-af2d209f-6293-4e06-a894-6bc83621b995 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.474s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:57 user nova-compute[74889]: DEBUG nova.network.neutron [req-ee649d4c-2f1d-4f3d-ad1d-57a2cd3163ed req-f333aebf-086a-4efc-abb7-3ac3d87118b4 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Updated VIF entry in instance network info cache for port da93881f-7f2f-401e-8dcd-a881954e3905. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:53:57 user nova-compute[74889]: DEBUG nova.network.neutron [req-ee649d4c-2f1d-4f3d-ad1d-57a2cd3163ed req-f333aebf-086a-4efc-abb7-3ac3d87118b4 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Updating instance_info_cache with network_info: [{"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:53:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ee649d4c-2f1d-4f3d-ad1d-57a2cd3163ed req-f333aebf-086a-4efc-abb7-3ac3d87118b4 service nova] Releasing lock "refresh_cache-54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:58 user nova-compute[74889]: INFO nova.compute.manager [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Rebuilding instance
Nov 10 11:53:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG os_brick.utils [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3222d7a0-11da-425b-8d4e-a6c8e7e63753]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea36c117-cbd3-4b1c-ad82-18a4034a8d12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08c072-c48b-4a23-92e9-6bfbb4d34c09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a185f100-1029-490d-972b-3a5beb8c4029]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-acfb30e3-ffd1-407a-bde7-5b03a5ef177c req-7bc5365b-5c09-400a-88f6-cb098d790452 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-vif-unplugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-acfb30e3-ffd1-407a-bde7-5b03a5ef177c req-7bc5365b-5c09-400a-88f6-cb098d790452 service nova] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-acfb30e3-ffd1-407a-bde7-5b03a5ef177c req-7bc5365b-5c09-400a-88f6-cb098d790452 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-acfb30e3-ffd1-407a-bde7-5b03a5ef177c req-7bc5365b-5c09-400a-88f6-cb098d790452 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-acfb30e3-ffd1-407a-bde7-5b03a5ef177c req-7bc5365b-5c09-400a-88f6-cb098d790452 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] No waiting events found dispatching network-vif-unplugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:53:59 user nova-compute[74889]: WARNING nova.compute.manager [req-acfb30e3-ffd1-407a-bde7-5b03a5ef177c req-7bc5365b-5c09-400a-88f6-cb098d790452 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received unexpected event network-vif-unplugged-da93881f-7f2f-401e-8dcd-a881954e3905 for instance with vm_state active and task_state rebuilding.
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:53:59 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[041ea667-51f8-4327-b102-5d38b202af9b]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.utils [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:53:59 user nova-compute[74889]: INFO nova.compute.manager [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Swapping volume a6f39e4b-de0e-4f77-8ad4-3c61538b2707 for d64b752b-be20-46ed-b790-dce922ccdd57
Nov 10 11:53:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Instance destroyed successfully.
Nov 10 11:53:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Instance destroyed successfully.
Nov 10 11:53:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1990135163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-868336549',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0uHLQXQj7dInSfVC9TaIgqa+9RQkjH42pg0qSxOcSGwGx0kYhgRvc39hCLN0H5L4IYuYHZeUvD0cEK5tcx4IArwdZ7cEmkvJUn/s+QbltOH4DHvllrCcGkdiSwTNa9tg==',key_name='tempest-keypair-27701663',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c0db768727f4544865ec53756cf5e4f',ramdisk_id='',reservation_id='r-3vgvinwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1329161327',owner_user_name='tempest-ServerActionsV293TestJSON-1329161327-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82bd448d0c3045aeb1114169f1a952b9',uuid=54fa74ec-d37c-4517-8f83-9ea1f23c1cc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converting VIF {"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_vif [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda93881f-7f, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77b59e9b-a695-48be-ac3f-88355e6f6e09) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:53:59 user nova-compute[74889]: INFO os_vif [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f')
Nov 10 11:53:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQcnwRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:53:59 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eefd83-47ea-4177-b6a2-04ae08d4da23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:53:59 user nova-compute[74889]: No targets found.
Nov 10 11:53:59 user nova-compute[74889]: iSNS:
Nov 10 11:53:59 user nova-compute[74889]: No targets found.
Nov 10 11:53:59 user nova-compute[74889]: STATIC:
Nov 10 11:53:59 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:53:59 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:53:59 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:53:59 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707
Nov 10 11:53:59 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:53:59 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:53:59 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3
Nov 10 11:53:59 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:53:59 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:53:59 user nova-compute[74889]: FIRMWARE:
Nov 10 11:53:59 user nova-compute[74889]: No targets found.
Nov 10 11:53:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:53:59 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:53:59 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8572f707-b54b-4c97-98e5-8c4c652c674c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fdcd77-dbba-4dc3-8c0d-2d330db09f17]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:59 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:59 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:53:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:53:59 user nova-compute[74889]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:53:59 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:53:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa39823e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b921c44a-3865-46f3-9b4e-b2034d3bf54e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b404ab-6f60-4f85-96e4-f6480ed36bdd]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e3b9e4-308e-40f8-b8f5-76b41950281b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd0407e-ebb0-442c-8219-962b439583d8]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO74dbf3ba-ffa7f68193bc96d1', '/dev/disk/by-id/scsi-26666613766363831', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_74dbf3ba') {{(pid=85601) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[52244f43-5467-493f-a020-3bcf053e80ae]: (4, None) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c21ab5-d0c7-4966-91a8-da4c86d13b69]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d1f704-141f-462f-8fe7-a5255025b07b]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260]
Nov 10 11:53:59 user nova-compute[74889]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260] successful.
Nov 10 11:53:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[416b5065-085b-4cac-be83-bbcb840edcd7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.412s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] <== disconnect_volume: return (414ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:53:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:53:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Deleting instance files /opt/stack/data/nova/instances/54fa74ec-d37c-4517-8f83-9ea1f23c1cc4_del
Nov 10 11:53:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Deletion of /opt/stack/data/nova/instances/54fa74ec-d37c-4517-8f83-9ea1f23c1cc4_del complete
Nov 10 11:54:00 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4 could not be found.
Nov 10 11:54:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQcnwRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:54:00 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5599b15-5e10-4395-a81c-c7655e5f9ae3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:54:00 user nova-compute[74889]: No targets found.
Nov 10 11:54:00 user nova-compute[74889]: iSNS:
Nov 10 11:54:00 user nova-compute[74889]: No targets found.
Nov 10 11:54:00 user nova-compute[74889]: STATIC:
Nov 10 11:54:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:54:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:54:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:54:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707
Nov 10 11:54:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:54:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:54:00 user nova-compute[74889]: FIRMWARE:
Nov 10 11:54:00 user nova-compute[74889]: No targets found.
Nov 10 11:54:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:54:00 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:54:00 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c6bbba-b053-45fd-8896-4d6e7f689435]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[71336499-fb23-437a-aac5-01c76c8ab888]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:54:00 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:54:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:54:00 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:54:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3983d2d40>, {}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Disconnecting from: [] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] <== disconnect_volume: return (87ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:54:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-c5b617fc-2c16-4417-9972-27bc2d553ab3 req-44493cd0-383c-4720-a168-befdb6bcee7f service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c5b617fc-2c16-4417-9972-27bc2d553ab3 req-44493cd0-383c-4720-a168-befdb6bcee7f service nova] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c5b617fc-2c16-4417-9972-27bc2d553ab3 req-44493cd0-383c-4720-a168-befdb6bcee7f service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c5b617fc-2c16-4417-9972-27bc2d553ab3 req-44493cd0-383c-4720-a168-befdb6bcee7f service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-c5b617fc-2c16-4417-9972-27bc2d553ab3 req-44493cd0-383c-4720-a168-befdb6bcee7f service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] No waiting events found dispatching network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:54:01 user nova-compute[74889]: WARNING nova.compute.manager [req-c5b617fc-2c16-4417-9972-27bc2d553ab3 req-44493cd0-383c-4720-a168-befdb6bcee7f service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received unexpected event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 for instance with vm_state active and task_state rebuilding.
Nov 10 11:54:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:54:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:54:13 user nova-compute[74889]: INFO nova.compute.claims [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Claim successful on node user
Nov 10 11:54:14 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:54:14 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:54:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG nova.policy [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0713f019fd484ce58496c9038295dad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde601a6b8e24d988c49013a8fe6f0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:54:14 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Creating image(s)
Nov 10 11:54:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "/opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "/opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "/opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.208s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.251s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk 1073741824" returned: 0 in 0.058s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.269s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Successfully created port: b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Cannot resize image /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Ensure instance console log exists: /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Successfully updated port: b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquired lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.compute.manager [req-a97f2983-00b5-4b41-a213-c17320e79710 req-f6d600ee-4ee7-4ffc-b5f1-d44d1f1e1861 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received event network-changed-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.compute.manager [req-a97f2983-00b5-4b41-a213-c17320e79710 req-f6d600ee-4ee7-4ffc-b5f1-d44d1f1e1861 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Refreshing instance network info cache due to event network-changed-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a97f2983-00b5-4b41-a213-c17320e79710 req-f6d600ee-4ee7-4ffc-b5f1-d44d1f1e1861 service nova] Acquiring lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updating instance_info_cache with network_info: [{"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Releasing lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Instance network_info: |[{"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a97f2983-00b5-4b41-a213-c17320e79710 req-f6d600ee-4ee7-4ffc-b5f1-d44d1f1e1861 service nova] Acquired lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.network.neutron [req-a97f2983-00b5-4b41-a213-c17320e79710 req-f6d600ee-4ee7-4ffc-b5f1-d44d1f1e1861 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Refreshing network info cache for port b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Start _get_guest_xml network_info=[{"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:54:17 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:54:17 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-383015866',display_name='tempest-TestStampPattern-server-383015866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-383015866',id=8,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxDwFs0AGsEtr15Zi6x2wsIDGQYgbiQSBAGO7YjoF8bCXJVpt9lKEMaMnjKkVdYpvjgsEv3fRCgW9Gc/EdEP0DEjX5Wcf4b9A5MJqJw73kiAjUo/ElWA2D+2WH2oMrVxQ==',key_name='tempest-TestStampPattern-81644911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde601a6b8e24d988c49013a8fe6f0fb',ramdisk_id='',reservation_id='r-0jx31zn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1182113080',owner_user_name='tempest-TestStampPattern-1182113080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:54:15Z,user_data=None,user_id='0713f019fd484ce58496c9038295dad3',uuid=6200554d-5be6-48b4-90e9-4151006d8ce3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converting VIF {"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:30:b8,bridge_name='br-int',has_traffic_filtering=True,id=b40bb580-99e7-4ca8-a45e-cd332d4e4cd7,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40bb580-99') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.objects.instance [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lazy-loading 'pci_devices' on Instance uuid 6200554d-5be6-48b4-90e9-4151006d8ce3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:54:17 user nova-compute[74889]:   <uuid>6200554d-5be6-48b4-90e9-4151006d8ce3</uuid>
Nov 10 11:54:17 user nova-compute[74889]:   <name>instance-00000008</name>
Nov 10 11:54:17 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:54:17 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:54:17 user nova-compute[74889]:   <metadata>
Nov 10 11:54:17 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:54:17 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:54:17 user nova-compute[74889]:       <nova:name>tempest-TestStampPattern-server-383015866</nova:name>
Nov 10 11:54:17 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:54:17</nova:creationTime>
Nov 10 11:54:17 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:54:17 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:54:17 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:54:17 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:54:17 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:54:17 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:54:17 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:54:17 user nova-compute[74889]:       <nova:owner>
Nov 10 11:54:17 user nova-compute[74889]:         <nova:user uuid="0713f019fd484ce58496c9038295dad3">tempest-TestStampPattern-1182113080-project-member</nova:user>
Nov 10 11:54:17 user nova-compute[74889]:         <nova:project uuid="cde601a6b8e24d988c49013a8fe6f0fb">tempest-TestStampPattern-1182113080</nova:project>
Nov 10 11:54:17 user nova-compute[74889]:       </nova:owner>
Nov 10 11:54:17 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:54:17 user nova-compute[74889]:       <nova:ports>
Nov 10 11:54:17 user nova-compute[74889]:         <nova:port uuid="b40bb580-99e7-4ca8-a45e-cd332d4e4cd7">
Nov 10 11:54:17 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 11:54:17 user nova-compute[74889]:         </nova:port>
Nov 10 11:54:17 user nova-compute[74889]:       </nova:ports>
Nov 10 11:54:17 user nova-compute[74889]:     </nova:instance>
Nov 10 11:54:17 user nova-compute[74889]:   </metadata>
Nov 10 11:54:17 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:54:17 user nova-compute[74889]:     <system>
Nov 10 11:54:17 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:54:17 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:54:17 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:54:17 user nova-compute[74889]:       <entry name="serial">6200554d-5be6-48b4-90e9-4151006d8ce3</entry>
Nov 10 11:54:17 user nova-compute[74889]:       <entry name="uuid">6200554d-5be6-48b4-90e9-4151006d8ce3</entry>
Nov 10 11:54:17 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:54:17 user nova-compute[74889]:     </system>
Nov 10 11:54:17 user nova-compute[74889]:   </sysinfo>
Nov 10 11:54:17 user nova-compute[74889]:   <os>
Nov 10 11:54:17 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:54:17 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:54:17 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:54:17 user nova-compute[74889]:   </os>
Nov 10 11:54:17 user nova-compute[74889]:   <features>
Nov 10 11:54:17 user nova-compute[74889]:     <acpi/>
Nov 10 11:54:17 user nova-compute[74889]:     <apic/>
Nov 10 11:54:17 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:54:17 user nova-compute[74889]:   </features>
Nov 10 11:54:17 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:54:17 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:54:17 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:54:17 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:54:17 user nova-compute[74889]:   </clock>
Nov 10 11:54:17 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:54:17 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:54:17 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:54:17 user nova-compute[74889]:   </cpu>
Nov 10 11:54:17 user nova-compute[74889]:   <devices>
Nov 10 11:54:17 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:54:17 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:54:17 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk"/>
Nov 10 11:54:17 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:54:17 user nova-compute[74889]:     </disk>
Nov 10 11:54:17 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:54:17 user nova-compute[74889]:       <mac address="fa:16:3e:3f:30:b8"/>
Nov 10 11:54:17 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:54:17 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:54:17 user nova-compute[74889]:       <target dev="tapb40bb580-99"/>
Nov 10 11:54:17 user nova-compute[74889]:     </interface>
Nov 10 11:54:17 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:54:17 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/console.log" append="off"/>
Nov 10 11:54:17 user nova-compute[74889]:     </serial>
Nov 10 11:54:17 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:54:17 user nova-compute[74889]:     <video>
Nov 10 11:54:17 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:54:17 user nova-compute[74889]:     </video>
Nov 10 11:54:17 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:54:17 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:54:17 user nova-compute[74889]:     </rng>
Nov 10 11:54:17 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:54:17 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:54:17 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:54:17 user nova-compute[74889]:     </memballoon>
Nov 10 11:54:17 user nova-compute[74889]:   </devices>
Nov 10 11:54:17 user nova-compute[74889]: </domain>
Nov 10 11:54:17 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-383015866',display_name='tempest-TestStampPattern-server-383015866',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-383015866',id=8,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxDwFs0AGsEtr15Zi6x2wsIDGQYgbiQSBAGO7YjoF8bCXJVpt9lKEMaMnjKkVdYpvjgsEv3fRCgW9Gc/EdEP0DEjX5Wcf4b9A5MJqJw73kiAjUo/ElWA2D+2WH2oMrVxQ==',key_name='tempest-TestStampPattern-81644911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde601a6b8e24d988c49013a8fe6f0fb',ramdisk_id='',reservation_id='r-0jx31zn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1182113080',owner_user_name='tempest-TestStampPattern-1182113080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:54:15Z,user_data=None,user_id='0713f019fd484ce58496c9038295dad3',uuid=6200554d-5be6-48b4-90e9-4151006d8ce3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converting VIF {"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:30:b8,bridge_name='br-int',has_traffic_filtering=True,id=b40bb580-99e7-4ca8-a45e-cd332d4e4cd7,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40bb580-99') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG os_vif [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:30:b8,bridge_name='br-int',has_traffic_filtering=True,id=b40bb580-99e7-4ca8-a45e-cd332d4e4cd7,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40bb580-99') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed38d7fc-7ff3-593a-9b54-0035f17a7d6a', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb40bb580-99, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb40bb580-99, col_values=(('qos', UUID('929dd640-60ba-4e93-916e-0837cbaa78de')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb40bb580-99, col_values=(('external_ids', {'iface-id': 'b40bb580-99e7-4ca8-a45e-cd332d4e4cd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:30:b8', 'vm-uuid': '6200554d-5be6-48b4-90e9-4151006d8ce3'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:54:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:17 user nova-compute[74889]: INFO os_vif [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:30:b8,bridge_name='br-int',has_traffic_filtering=True,id=b40bb580-99e7-4ca8-a45e-cd332d4e4cd7,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40bb580-99')
Nov 10 11:54:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:54:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] No VIF found with MAC fa:16:3e:3f:30:b8, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:54:18 user nova-compute[74889]: DEBUG nova.network.neutron [req-a97f2983-00b5-4b41-a213-c17320e79710 req-f6d600ee-4ee7-4ffc-b5f1-d44d1f1e1861 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updated VIF entry in instance network info cache for port b40bb580-99e7-4ca8-a45e-cd332d4e4cd7. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:54:18 user nova-compute[74889]: DEBUG nova.network.neutron [req-a97f2983-00b5-4b41-a213-c17320e79710 req-f6d600ee-4ee7-4ffc-b5f1-d44d1f1e1861 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updating instance_info_cache with network_info: [{"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:54:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a97f2983-00b5-4b41-a213-c17320e79710 req-f6d600ee-4ee7-4ffc-b5f1-d44d1f1e1861 service nova] Releasing lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:54:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Preparing to wait for external event volume-reimaged-83e12811-d82a-4e65-a0b1-b4c84ecad9e3 {{(pid=74889) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-df419ee3-63e8-42ab-a231-45fbbe8744b9 req-ce7bba59-e051-458e-a94d-9837db43bfef service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received event network-vif-plugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-df419ee3-63e8-42ab-a231-45fbbe8744b9 req-ce7bba59-e051-458e-a94d-9837db43bfef service nova] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-df419ee3-63e8-42ab-a231-45fbbe8744b9 req-ce7bba59-e051-458e-a94d-9837db43bfef service nova] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-df419ee3-63e8-42ab-a231-45fbbe8744b9 req-ce7bba59-e051-458e-a94d-9837db43bfef service nova] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-df419ee3-63e8-42ab-a231-45fbbe8744b9 req-ce7bba59-e051-458e-a94d-9837db43bfef service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] No waiting events found dispatching network-vif-plugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:54:19 user nova-compute[74889]: WARNING nova.compute.manager [req-df419ee3-63e8-42ab-a231-45fbbe8744b9 req-ce7bba59-e051-458e-a94d-9837db43bfef service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received unexpected event network-vif-plugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 for instance with vm_state building and task_state spawning.
Nov 10 11:54:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-39844c77-a706-4893-a66b-3ec6935a9489 req-55a1c21b-c66f-42b4-ad8d-fb7c8b82231b service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received event network-vif-plugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39844c77-a706-4893-a66b-3ec6935a9489 req-55a1c21b-c66f-42b4-ad8d-fb7c8b82231b service nova] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39844c77-a706-4893-a66b-3ec6935a9489 req-55a1c21b-c66f-42b4-ad8d-fb7c8b82231b service nova] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39844c77-a706-4893-a66b-3ec6935a9489 req-55a1c21b-c66f-42b4-ad8d-fb7c8b82231b service nova] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-39844c77-a706-4893-a66b-3ec6935a9489 req-55a1c21b-c66f-42b4-ad8d-fb7c8b82231b service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] No waiting events found dispatching network-vif-plugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:54:21 user nova-compute[74889]: WARNING nova.compute.manager [req-39844c77-a706-4893-a66b-3ec6935a9489 req-55a1c21b-c66f-42b4-ad8d-fb7c8b82231b service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received unexpected event network-vif-plugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 for instance with vm_state building and task_state spawning.
Nov 10 11:54:22 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:54:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:54:22 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Instance spawned successfully.
Nov 10 11:54:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:54:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:22 user nova-compute[74889]: INFO nova.compute.manager [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Took 7.50 seconds to spawn the instance on the hypervisor.
Nov 10 11:54:22 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:54:22 user nova-compute[74889]: INFO nova.compute.manager [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Took 8.40 seconds to build instance.
Nov 10 11:54:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0aa04ff0-a4b4-4e33-9bbf-59f83e73e8c2 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.551s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "ff790962-c708-465c-a240-36748871cfda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:27 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:54:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:54:27 user nova-compute[74889]: INFO nova.compute.claims [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Claim successful on node user
Nov 10 11:54:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:54:28 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:54:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG nova.policy [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f4638ca003c46dab10aab2e5a2e6fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688cad5e5288440bb533d6e2c2f764c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:54:28 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Creating image(s)
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "/opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "/opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.222s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.264s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk 1073741824" returned: 0 in 0.064s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHrLOZzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62224c8d-72a9-449a-ab5b-376197157c3e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd64b752b-be20-46ed-b790-dce922ccdd57', 'serial': 'd64b752b-be20-46ed-b790-dce922ccdd57'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjAtDHYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '62224c8d-72a9-449a-ab5b-376197157c3e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'serial'} {{(pid=74889) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHrLOZzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:54:29 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:54:29 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:54:29 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a016be8-ec1b-4b04-9688-e4fc6093d93f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:54:29 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba76aec-2562-4b77-8f0a-07707e501f9e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57] added
Nov 10 11:54:29 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f00c4-3e93-4a09-bc73-38f22bfbd269]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[297d7b05-a4c4-48d3-97a0-eb1f68f06762]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bHrLOZzE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bHrLOZzE" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5311e613-5213-4fad-99de-bd9e72c1899d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bHrLOZzE'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.278s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f98767-09c5-4384-b4ed-2d068f8f23a7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b595d3d4-d0dc-4e86-8434-81ab2a33b24f]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:54:29 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:54:29 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:54:29 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:54:29 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Successfully created port: 9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9873e9-3d25-4cfd-ab2c-247905068c53]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57, portal: 172.16.0.220,3260]
Nov 10 11:54:29 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57, portal: 172.16.0.220,3260] successful.
Nov 10 11:54:29 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd7e986-2875-4ef2-8285-2bbae34a6406]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f438ad8c-0fef-455f-9fbc-aa7a2feb334e]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:54:29 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:54:29 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:54:29 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:54:29 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:54:29 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:54:29 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.418s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58e3918-21ec-466b-a6d0-ffbf01358865]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHrLOZzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Cannot resize image /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Ensure instance console log exists: /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '23064376132613431', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064376132613431', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Successfully updated port: 9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG nova.objects.instance [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lazy-loading 'flavor' on Instance uuid 62224c8d-72a9-449a-ab5b-376197157c3e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquired lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-c5e2727d-3619-4216-af57-239147d1493e req-4b380db5-0d14-4009-b749-4376bf5bf9b3 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-changed-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-c5e2727d-3619-4216-af57-239147d1493e req-4b380db5-0d14-4009-b749-4376bf5bf9b3 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Refreshing instance network info cache due to event network-changed-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c5e2727d-3619-4216-af57-239147d1493e req-4b380db5-0d14-4009-b749-4376bf5bf9b3 service nova] Acquiring lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Updating instance_info_cache with network_info: [{"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 2097152 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Releasing lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Instance network_info: |[{"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c5e2727d-3619-4216-af57-239147d1493e req-4b380db5-0d14-4009-b749-4376bf5bf9b3 service nova] Acquired lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-c5e2727d-3619-4216-af57-239147d1493e req-4b380db5-0d14-4009-b749-4376bf5bf9b3 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Refreshing network info cache for port 9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Start _get_guest_xml network_info=[{"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:54:31 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:54:31 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-642189030',display_name='tempest-tempest.common.compute-instance-642189030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-642189030',id=9,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0/XF+AB0GhusuxdUy4KCbA5BHH0mEXd6UsrJkBP5cRseQe4LcHZRtV1gX4Erce1ZdBd4lGhhKkzpZ8/b9Vm+ldnYnA6+7h9G9k9ev9qm8TXn29kna1Abvhrmq647o0WA==',key_name='tempest-keypair-958761505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-fqz1x6s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=ff790962-c708-465c-a240-36748871cfda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'pci_devices' on Instance uuid ff790962-c708-465c-a240-36748871cfda {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:54:31 user nova-compute[74889]:   <uuid>ff790962-c708-465c-a240-36748871cfda</uuid>
Nov 10 11:54:31 user nova-compute[74889]:   <name>instance-00000009</name>
Nov 10 11:54:31 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:54:31 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:54:31 user nova-compute[74889]:   <metadata>
Nov 10 11:54:31 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:54:31 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:54:31 user nova-compute[74889]:       <nova:name>tempest-tempest.common.compute-instance-642189030</nova:name>
Nov 10 11:54:31 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:54:31</nova:creationTime>
Nov 10 11:54:31 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:54:31 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:54:31 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:54:31 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:54:31 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:54:31 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:54:31 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:54:31 user nova-compute[74889]:       <nova:owner>
Nov 10 11:54:31 user nova-compute[74889]:         <nova:user uuid="8f4638ca003c46dab10aab2e5a2e6fb4">tempest-ServerActionsTestOtherA-631643283-project-member</nova:user>
Nov 10 11:54:31 user nova-compute[74889]:         <nova:project uuid="688cad5e5288440bb533d6e2c2f764c1">tempest-ServerActionsTestOtherA-631643283</nova:project>
Nov 10 11:54:31 user nova-compute[74889]:       </nova:owner>
Nov 10 11:54:31 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:54:31 user nova-compute[74889]:       <nova:ports>
Nov 10 11:54:31 user nova-compute[74889]:         <nova:port uuid="9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53">
Nov 10 11:54:31 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 11:54:31 user nova-compute[74889]:         </nova:port>
Nov 10 11:54:31 user nova-compute[74889]:       </nova:ports>
Nov 10 11:54:31 user nova-compute[74889]:     </nova:instance>
Nov 10 11:54:31 user nova-compute[74889]:   </metadata>
Nov 10 11:54:31 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:54:31 user nova-compute[74889]:     <system>
Nov 10 11:54:31 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:54:31 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:54:31 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:54:31 user nova-compute[74889]:       <entry name="serial">ff790962-c708-465c-a240-36748871cfda</entry>
Nov 10 11:54:31 user nova-compute[74889]:       <entry name="uuid">ff790962-c708-465c-a240-36748871cfda</entry>
Nov 10 11:54:31 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:54:31 user nova-compute[74889]:     </system>
Nov 10 11:54:31 user nova-compute[74889]:   </sysinfo>
Nov 10 11:54:31 user nova-compute[74889]:   <os>
Nov 10 11:54:31 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:54:31 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:54:31 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:54:31 user nova-compute[74889]:   </os>
Nov 10 11:54:31 user nova-compute[74889]:   <features>
Nov 10 11:54:31 user nova-compute[74889]:     <acpi/>
Nov 10 11:54:31 user nova-compute[74889]:     <apic/>
Nov 10 11:54:31 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:54:31 user nova-compute[74889]:   </features>
Nov 10 11:54:31 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:54:31 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:54:31 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:54:31 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:54:31 user nova-compute[74889]:   </clock>
Nov 10 11:54:31 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:54:31 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:54:31 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:54:31 user nova-compute[74889]:   </cpu>
Nov 10 11:54:31 user nova-compute[74889]:   <devices>
Nov 10 11:54:31 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:54:31 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:54:31 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk"/>
Nov 10 11:54:31 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:54:31 user nova-compute[74889]:     </disk>
Nov 10 11:54:31 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:54:31 user nova-compute[74889]:       <mac address="fa:16:3e:28:d7:7a"/>
Nov 10 11:54:31 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:54:31 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:54:31 user nova-compute[74889]:       <target dev="tap9cf86e63-f9"/>
Nov 10 11:54:31 user nova-compute[74889]:     </interface>
Nov 10 11:54:31 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:54:31 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/console.log" append="off"/>
Nov 10 11:54:31 user nova-compute[74889]:     </serial>
Nov 10 11:54:31 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:54:31 user nova-compute[74889]:     <video>
Nov 10 11:54:31 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:54:31 user nova-compute[74889]:     </video>
Nov 10 11:54:31 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:54:31 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:54:31 user nova-compute[74889]:     </rng>
Nov 10 11:54:31 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:54:31 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:54:31 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:54:31 user nova-compute[74889]:     </memballoon>
Nov 10 11:54:31 user nova-compute[74889]:   </devices>
Nov 10 11:54:31 user nova-compute[74889]: </domain>
Nov 10 11:54:31 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-642189030',display_name='tempest-tempest.common.compute-instance-642189030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-642189030',id=9,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0/XF+AB0GhusuxdUy4KCbA5BHH0mEXd6UsrJkBP5cRseQe4LcHZRtV1gX4Erce1ZdBd4lGhhKkzpZ8/b9Vm+ldnYnA6+7h9G9k9ev9qm8TXn29kna1Abvhrmq647o0WA==',key_name='tempest-keypair-958761505',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-fqz1x6s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:54:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=ff790962-c708-465c-a240-36748871cfda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG os_vif [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f293219-6465-58bd-92b9-9370c1e68826', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cf86e63-f9, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cf86e63-f9, col_values=(('qos', UUID('c32db711-ebdd-43a0-a9bd-c9148d8aac23')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cf86e63-f9, col_values=(('external_ids', {'iface-id': '9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:d7:7a', 'vm-uuid': 'ff790962-c708-465c-a240-36748871cfda'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:31 user nova-compute[74889]: INFO os_vif [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9')
Nov 10 11:54:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4/disk --force-share --output=json" returned: 0 in 0.360s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 106954752 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:54:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No VIF found with MAC fa:16:3e:28:d7:7a, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 216006656 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-c5e2727d-3619-4216-af57-239147d1493e req-4b380db5-0d14-4009-b749-4376bf5bf9b3 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Updated VIF entry in instance network info cache for port 9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-c5e2727d-3619-4216-af57-239147d1493e req-4b380db5-0d14-4009-b749-4376bf5bf9b3 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Updating instance_info_cache with network_info: [{"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c5e2727d-3619-4216-af57-239147d1493e req-4b380db5-0d14-4009-b749-4376bf5bf9b3 service nova] Releasing lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:54:32 user nova-compute[74889]: INFO nova.compute.claims [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Claim successful on node user
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 295698432 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.792s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 448790528 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:54:33 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.policy [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f688fe301af64abfad9a6750035f27bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e233f699d30349eeac9c998bca441273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:54:33 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Creating image(s)
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "/opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "/opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "/opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 585105408 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.362s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.351s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Successfully created port: c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-8c7d041d-82b5-4ce9-a9a9-034daa6c4e99 req-d5e04b79-2ae2-4acd-84f8-2f29c70b1aa0 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8c7d041d-82b5-4ce9-a9a9-034daa6c4e99 req-d5e04b79-2ae2-4acd-84f8-2f29c70b1aa0 service nova] Acquiring lock "ff790962-c708-465c-a240-36748871cfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8c7d041d-82b5-4ce9-a9a9-034daa6c4e99 req-d5e04b79-2ae2-4acd-84f8-2f29c70b1aa0 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8c7d041d-82b5-4ce9-a9a9-034daa6c4e99 req-d5e04b79-2ae2-4acd-84f8-2f29c70b1aa0 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-8c7d041d-82b5-4ce9-a9a9-034daa6c4e99 req-d5e04b79-2ae2-4acd-84f8-2f29c70b1aa0 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] No waiting events found dispatching network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:54:37 user nova-compute[74889]: WARNING nova.compute.manager [req-8c7d041d-82b5-4ce9-a9a9-034daa6c4e99 req-d5e04b79-2ae2-4acd-84f8-2f29c70b1aa0 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received unexpected event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 for instance with vm_state building and task_state spawning.
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-9fcba4ea-4286-4726-b15f-71a520c6b197 req-397aae11-f6f0-4177-8e12-f8baccc957d6 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9fcba4ea-4286-4726-b15f-71a520c6b197 req-397aae11-f6f0-4177-8e12-f8baccc957d6 service nova] Acquiring lock "ff790962-c708-465c-a240-36748871cfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9fcba4ea-4286-4726-b15f-71a520c6b197 req-397aae11-f6f0-4177-8e12-f8baccc957d6 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9fcba4ea-4286-4726-b15f-71a520c6b197 req-397aae11-f6f0-4177-8e12-f8baccc957d6 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-9fcba4ea-4286-4726-b15f-71a520c6b197 req-397aae11-f6f0-4177-8e12-f8baccc957d6 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] No waiting events found dispatching network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:54:37 user nova-compute[74889]: WARNING nova.compute.manager [req-9fcba4ea-4286-4726-b15f-71a520c6b197 req-397aae11-f6f0-4177-8e12-f8baccc957d6 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received unexpected event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 for instance with vm_state building and task_state spawning.
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 3.519s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: ff790962-c708-465c-a240-36748871cfda] Instance spawned successfully.
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk 1073741824" returned: 0 in 0.108s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 3.642s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:37 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:54:37 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8306MB free_disk=25.688602447509766GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjAtDHYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:54:37 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:54:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[299215fb-a6e7-4de1-9e8f-51372b06b724]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:54:37 user nova-compute[74889]: No targets found.
Nov 10 11:54:37 user nova-compute[74889]: iSNS:
Nov 10 11:54:37 user nova-compute[74889]: No targets found.
Nov 10 11:54:37 user nova-compute[74889]: STATIC:
Nov 10 11:54:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:54:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:54:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:54:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707
Nov 10 11:54:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:54:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:54:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57
Nov 10 11:54:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:54:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:54:37 user nova-compute[74889]: FIRMWARE:
Nov 10 11:54:37 user nova-compute[74889]: No targets found.
Nov 10 11:54:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:54:37 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:54:37 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27f2c22-6a4d-47bc-b8d9-3d0ec62fc746]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.244s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:54:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0646df0-5321-483f-b45d-aeb4cbd4233c]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:54:38 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:54:38 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:54:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:54:38 user nova-compute[74889]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:54:38 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:54:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3885e3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:54:38 user nova-compute[74889]: INFO nova.compute.manager [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Took 9.57 seconds to spawn the instance on the hypervisor.
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5451a2-b4c4-4b24-8a2b-37dce1434bc5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 133007ba-7922-43b9-babc-4e32bd0dcb1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 62224c8d-72a9-449a-ab5b-376197157c3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6200554d-5be6-48b4-90e9-4151006d8ce3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance ff790962-c708-465c-a240-36748871cfda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 81cfb431-3aee-4081-82ba-49612a294d61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eb5b0d-d150-4d71-aeae-5a579bda6069]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e6df54-34b7-4a49-8f21-46c61fa024d1]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cece680e-1427-4bad-86d9-67724f7d6c16]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Cannot resize image /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Ensure instance console log exists: /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:38 user nova-compute[74889]: INFO nova.compute.manager [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Took 10.70 seconds to build instance.
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce76855-9339-42da-840c-ae3247cfa44a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e71aa357-74cb-4732-839d-7d13c1ae01cf tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.836s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --logout" returned: 0 in 0.181s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ca720-66f0-45ae-8eb4-04db51aff511]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260]
Nov 10 11:54:38 user nova-compute[74889]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260] successful.
Nov 10 11:54:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c1f89d-4b3c-4a65-aa64-cf28d8e7b6fd]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.601s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] <== disconnect_volume: return (604ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHrLOZzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '62224c8d-72a9-449a-ab5b-376197157c3e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd64b752b-be20-46ed-b790-dce922ccdd57', 'serial'} {{(pid=74889) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] swap_volume: removing Cinder connection for volume a6f39e4b-de0e-4f77-8ad4-3c61538b2707 {{(pid=74889) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Successfully updated port: c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquired lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.975s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Acquiring lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Acquiring lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:38 user nova-compute[74889]: INFO nova.compute.manager [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Terminating instance
Nov 10 11:54:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 11:54:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Updating instance_info_cache with network_info: [{"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Releasing lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Instance network_info: |[{"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Start _get_guest_xml network_info=[{"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:54:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:54:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1580238869',display_name='tempest-TestServerVolumeAttachmentScenario-server-1580238869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1580238869',id=10,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2a2SxXxtm+bAy8TOYYaRgwy+jfq0jWYq90NIymi6yqSUOJGG5OsmLYXVuQ0c9Aggyup1dZlDIA8zMDtEGJ7+7J9WM5+1hCEfAP0a1dQr385EFFgxw5Y5zcG8lN/X8cwg==',key_name='tempest-keypair-532379226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e233f699d30349eeac9c998bca441273',ramdisk_id='',reservation_id='r-rc3vfi6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-22575309',owner_user_name='tempest-TestServerVolumeAttachmentScenario-22575309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f688fe301af64abfad9a6750035f27bc',uuid=81cfb431-3aee-4081-82ba-49612a294d61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Converting VIF {"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:09,bridge_name='br-int',has_traffic_filtering=True,id=c63694e5-beaf-49f0-9dab-7bde0d79d1ad,network=Network(9f5143ba-a259-4cc8-be9c-c8f254c1ca7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63694e5-be') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lazy-loading 'pci_devices' on Instance uuid 81cfb431-3aee-4081-82ba-49612a294d61 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-a4784df0-e95e-470b-924e-ae39a8a1fc63 req-70ea750e-410f-4880-a51d-77bb54cfcbf7 service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received event network-changed-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-a4784df0-e95e-470b-924e-ae39a8a1fc63 req-70ea750e-410f-4880-a51d-77bb54cfcbf7 service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Refreshing instance network info cache due to event network-changed-c63694e5-beaf-49f0-9dab-7bde0d79d1ad. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a4784df0-e95e-470b-924e-ae39a8a1fc63 req-70ea750e-410f-4880-a51d-77bb54cfcbf7 service nova] Acquiring lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a4784df0-e95e-470b-924e-ae39a8a1fc63 req-70ea750e-410f-4880-a51d-77bb54cfcbf7 service nova] Acquired lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.network.neutron [req-a4784df0-e95e-470b-924e-ae39a8a1fc63 req-70ea750e-410f-4880-a51d-77bb54cfcbf7 service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Refreshing network info cache for port c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:54:39 user nova-compute[74889]:   <uuid>81cfb431-3aee-4081-82ba-49612a294d61</uuid>
Nov 10 11:54:39 user nova-compute[74889]:   <name>instance-0000000a</name>
Nov 10 11:54:39 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:54:39 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:54:39 user nova-compute[74889]:   <metadata>
Nov 10 11:54:39 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:54:39 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:54:39 user nova-compute[74889]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1580238869</nova:name>
Nov 10 11:54:39 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:54:39</nova:creationTime>
Nov 10 11:54:39 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:54:39 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:54:39 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:54:39 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:54:39 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:54:39 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:54:39 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:54:39 user nova-compute[74889]:       <nova:owner>
Nov 10 11:54:39 user nova-compute[74889]:         <nova:user uuid="f688fe301af64abfad9a6750035f27bc">tempest-TestServerVolumeAttachmentScenario-22575309-project-member</nova:user>
Nov 10 11:54:39 user nova-compute[74889]:         <nova:project uuid="e233f699d30349eeac9c998bca441273">tempest-TestServerVolumeAttachmentScenario-22575309</nova:project>
Nov 10 11:54:39 user nova-compute[74889]:       </nova:owner>
Nov 10 11:54:39 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:54:39 user nova-compute[74889]:       <nova:ports>
Nov 10 11:54:39 user nova-compute[74889]:         <nova:port uuid="c63694e5-beaf-49f0-9dab-7bde0d79d1ad">
Nov 10 11:54:39 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 11:54:39 user nova-compute[74889]:         </nova:port>
Nov 10 11:54:39 user nova-compute[74889]:       </nova:ports>
Nov 10 11:54:39 user nova-compute[74889]:     </nova:instance>
Nov 10 11:54:39 user nova-compute[74889]:   </metadata>
Nov 10 11:54:39 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:54:39 user nova-compute[74889]:     <system>
Nov 10 11:54:39 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:54:39 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:54:39 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:54:39 user nova-compute[74889]:       <entry name="serial">81cfb431-3aee-4081-82ba-49612a294d61</entry>
Nov 10 11:54:39 user nova-compute[74889]:       <entry name="uuid">81cfb431-3aee-4081-82ba-49612a294d61</entry>
Nov 10 11:54:39 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:54:39 user nova-compute[74889]:     </system>
Nov 10 11:54:39 user nova-compute[74889]:   </sysinfo>
Nov 10 11:54:39 user nova-compute[74889]:   <os>
Nov 10 11:54:39 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:54:39 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:54:39 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:54:39 user nova-compute[74889]:   </os>
Nov 10 11:54:39 user nova-compute[74889]:   <features>
Nov 10 11:54:39 user nova-compute[74889]:     <acpi/>
Nov 10 11:54:39 user nova-compute[74889]:     <apic/>
Nov 10 11:54:39 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:54:39 user nova-compute[74889]:   </features>
Nov 10 11:54:39 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:54:39 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:54:39 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:54:39 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:54:39 user nova-compute[74889]:   </clock>
Nov 10 11:54:39 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:54:39 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:54:39 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:54:39 user nova-compute[74889]:   </cpu>
Nov 10 11:54:39 user nova-compute[74889]:   <devices>
Nov 10 11:54:39 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:54:39 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:54:39 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk"/>
Nov 10 11:54:39 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:54:39 user nova-compute[74889]:     </disk>
Nov 10 11:54:39 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:54:39 user nova-compute[74889]:       <mac address="fa:16:3e:f4:9b:09"/>
Nov 10 11:54:39 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:54:39 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:54:39 user nova-compute[74889]:       <target dev="tapc63694e5-be"/>
Nov 10 11:54:39 user nova-compute[74889]:     </interface>
Nov 10 11:54:39 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:54:39 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/console.log" append="off"/>
Nov 10 11:54:39 user nova-compute[74889]:     </serial>
Nov 10 11:54:39 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:54:39 user nova-compute[74889]:     <video>
Nov 10 11:54:39 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:54:39 user nova-compute[74889]:     </video>
Nov 10 11:54:39 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:54:39 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:54:39 user nova-compute[74889]:     </rng>
Nov 10 11:54:39 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:54:39 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:54:39 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:54:39 user nova-compute[74889]:     </memballoon>
Nov 10 11:54:39 user nova-compute[74889]:   </devices>
Nov 10 11:54:39 user nova-compute[74889]: </domain>
Nov 10 11:54:39 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1580238869',display_name='tempest-TestServerVolumeAttachmentScenario-server-1580238869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1580238869',id=10,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2a2SxXxtm+bAy8TOYYaRgwy+jfq0jWYq90NIymi6yqSUOJGG5OsmLYXVuQ0c9Aggyup1dZlDIA8zMDtEGJ7+7J9WM5+1hCEfAP0a1dQr385EFFgxw5Y5zcG8lN/X8cwg==',key_name='tempest-keypair-532379226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e233f699d30349eeac9c998bca441273',ramdisk_id='',reservation_id='r-rc3vfi6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-22575309',owner_user_name='tempest-TestServerVolumeAttachmentScenario-22575309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f688fe301af64abfad9a6750035f27bc',uuid=81cfb431-3aee-4081-82ba-49612a294d61,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Converting VIF {"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:09,bridge_name='br-int',has_traffic_filtering=True,id=c63694e5-beaf-49f0-9dab-7bde0d79d1ad,network=Network(9f5143ba-a259-4cc8-be9c-c8f254c1ca7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63694e5-be') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG os_vif [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:09,bridge_name='br-int',has_traffic_filtering=True,id=c63694e5-beaf-49f0-9dab-7bde0d79d1ad,network=Network(9f5143ba-a259-4cc8-be9c-c8f254c1ca7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63694e5-be') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ff2f3d2-0b7e-545e-894a-dce157ac5a6b', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-5e9633e7-4c8d-49be-8156-cba6592ec3eb req-b1c95e76-63e1-4938-afcf-1e974a145e53 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received event network-vif-unplugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e9633e7-4c8d-49be-8156-cba6592ec3eb req-b1c95e76-63e1-4938-afcf-1e974a145e53 service nova] Acquiring lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e9633e7-4c8d-49be-8156-cba6592ec3eb req-b1c95e76-63e1-4938-afcf-1e974a145e53 service nova] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e9633e7-4c8d-49be-8156-cba6592ec3eb req-b1c95e76-63e1-4938-afcf-1e974a145e53 service nova] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-5e9633e7-4c8d-49be-8156-cba6592ec3eb req-b1c95e76-63e1-4938-afcf-1e974a145e53 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] No waiting events found dispatching network-vif-unplugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-5e9633e7-4c8d-49be-8156-cba6592ec3eb req-b1c95e76-63e1-4938-afcf-1e974a145e53 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received event network-vif-unplugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc63694e5-be, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc63694e5-be, col_values=(('qos', UUID('6f63f1e6-b8cd-40aa-b8da-6cbe9e738a0f')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc63694e5-be, col_values=(('external_ids', {'iface-id': 'c63694e5-beaf-49f0-9dab-7bde0d79d1ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:9b:09', 'vm-uuid': '81cfb431-3aee-4081-82ba-49612a294d61'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:39 user nova-compute[74889]: INFO os_vif [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9b:09,bridge_name='br-int',has_traffic_filtering=True,id=c63694e5-beaf-49f0-9dab-7bde0d79d1ad,network=Network(9f5143ba-a259-4cc8-be9c-c8f254c1ca7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63694e5-be')
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:54:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] No VIF found with MAC fa:16:3e:f4:9b:09, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.network.neutron [req-a4784df0-e95e-470b-924e-ae39a8a1fc63 req-70ea750e-410f-4880-a51d-77bb54cfcbf7 service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Updated VIF entry in instance network info cache for port c63694e5-beaf-49f0-9dab-7bde0d79d1ad. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.network.neutron [req-a4784df0-e95e-470b-924e-ae39a8a1fc63 req-70ea750e-410f-4880-a51d-77bb54cfcbf7 service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Updating instance_info_cache with network_info: [{"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a4784df0-e95e-470b-924e-ae39a8a1fc63 req-70ea750e-410f-4880-a51d-77bb54cfcbf7 service nova] Releasing lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] swap_volume: Updating volume a6f39e4b-de0e-4f77-8ad4-3c61538b2707 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "bHrLOZzE", "auth_password": "zG1pt2DhyQrxT8", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "d64b752b-be20-46ed-b790-dce922ccdd57"}, "status": "reserved", "instance": "62224c8d-72a9-449a-ab5b-376197157c3e", "attached_at": "", "detached_at": "", "volume_id": "d64b752b-be20-46ed-b790-dce922ccdd57", "serial": "d64b752b-be20-46ed-b790-dce922ccdd57"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd64b752b-be20-46ed-b790-dce922ccdd57', 'no_device': None, 'attachment_id': 'dcfca3c4-aa3a-4525-878d-f0e5a8f3b71d'} {{(pid=74889) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-46ef45dd-e51b-4ef9-a80e-036cff9b27ba tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 41.312s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Instance destroyed successfully.
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.objects.instance [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lazy-loading 'resources' on Instance uuid 330f6b5b-9e60-42bf-be67-981a13e29ef4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-870779479',display_name='tempest-VolumesAssistedSnapshotsTest-server-870779479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-870779479',id=5,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcRqg/O6xMDUO4fB7D+pdYMkKFeJvOQcA7E7cqgulnDE61JbF/h8dqSyzouKe1waT6OUHU6ouG2XzwLPp1tCTMOlNWoaflFUfbbyQV4V0jKwRQ/zz24wfO/9ZW6ScBNRQ==',key_name='tempest-keypair-648246847',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:51:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59070eb884ca43ddabc579ef81f9701e',ramdisk_id='',reservation_id='r-1rojingg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-540390099',owner_user_name='tempest-VolumesAssistedSnapshotsTest-540390099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fe0e1832aea4faaaf4231c534ce5677',uuid=330f6b5b-9e60-42bf-be67-981a13e29ef4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Converting VIF {"id": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "address": "fa:16:3e:bc:80:af", "network": {"id": "af3de3f0-a686-4f7c-9275-f33dd525e8b9", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-177296591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59070eb884ca43ddabc579ef81f9701e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84a0b161-da", "ovs_interfaceid": "84a0b161-daed-42f6-8f9f-61cacf7c4798", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:80:af,bridge_name='br-int',has_traffic_filtering=True,id=84a0b161-daed-42f6-8f9f-61cacf7c4798,network=Network(af3de3f0-a686-4f7c-9275-f33dd525e8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a0b161-da') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG os_vif [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:80:af,bridge_name='br-int',has_traffic_filtering=True,id=84a0b161-daed-42f6-8f9f-61cacf7c4798,network=Network(af3de3f0-a686-4f7c-9275-f33dd525e8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a0b161-da') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84a0b161-da, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ece3cd46-ede8-4ec6-88ac-8cae9df6fb05) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:40 user nova-compute[74889]: INFO os_vif [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:80:af,bridge_name='br-int',has_traffic_filtering=True,id=84a0b161-daed-42f6-8f9f-61cacf7c4798,network=Network(af3de3f0-a686-4f7c-9275-f33dd525e8b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84a0b161-da')
Nov 10 11:54:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Deleting instance files /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4_del
Nov 10 11:54:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Deletion of /opt/stack/data/nova/instances/330f6b5b-9e60-42bf-be67-981a13e29ef4_del complete
Nov 10 11:54:40 user nova-compute[74889]: INFO nova.compute.manager [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Took 1.73 seconds to destroy the instance on the hypervisor.
Nov 10 11:54:40 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:54:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG os_brick.utils [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c166a09-3a9c-415d-93d7-d6bc2362a2ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b83e0f-4a42-4dfe-9a48-70d14a2b61ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e8854f-000f-4ded-a04e-a40668fc0cb8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[defe23f2-3393-4cb9-b999-11d47bcf2733]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:54:41 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[941cb67a-7221-4743-a034-0a565d76e384]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG os_brick.utils [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] <== get_connector_properties: return (208ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-0be57a19-07e4-42cc-b011-d7913526f516 req-473564c4-52c9-4bc4-b096-c79ccb237590 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received event network-vif-plugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0be57a19-07e4-42cc-b011-d7913526f516 req-473564c4-52c9-4bc4-b096-c79ccb237590 service nova] Acquiring lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0be57a19-07e4-42cc-b011-d7913526f516 req-473564c4-52c9-4bc4-b096-c79ccb237590 service nova] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0be57a19-07e4-42cc-b011-d7913526f516 req-473564c4-52c9-4bc4-b096-c79ccb237590 service nova] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-0be57a19-07e4-42cc-b011-d7913526f516 req-473564c4-52c9-4bc4-b096-c79ccb237590 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] No waiting events found dispatching network-vif-plugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:54:41 user nova-compute[74889]: WARNING nova.compute.manager [req-0be57a19-07e4-42cc-b011-d7913526f516 req-473564c4-52c9-4bc4-b096-c79ccb237590 service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received unexpected event network-vif-plugged-84a0b161-daed-42f6-8f9f-61cacf7c4798 for instance with vm_state active and task_state deleting.
Nov 10 11:54:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Updating instance_info_cache with network_info: [{"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-133007ba-7922-43b9-babc-4e32bd0dcb1f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:54:41 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:54:41 user nova-compute[74889]: INFO nova.compute.manager [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Swapping volume d64b752b-be20-46ed-b790-dce922ccdd57 for a6f39e4b-de0e-4f77-8ad4-3c61538b2707
Nov 10 11:54:41 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:54:41 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Took 1.39 seconds to deallocate network for instance.
Nov 10 11:54:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-572342d8-49d6-41c0-96b8-6c8cc972c4d3 req-43f75e69-11e8-4029-8fd3-0d88adb585ae service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Received event network-vif-deleted-84a0b161-daed-42f6-8f9f-61cacf7c4798 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:42 user nova-compute[74889]: INFO nova.compute.manager [req-572342d8-49d6-41c0-96b8-6c8cc972c4d3 req-43f75e69-11e8-4029-8fd3-0d88adb585ae service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Neutron deleted interface 84a0b161-daed-42f6-8f9f-61cacf7c4798; detaching it from the instance and deleting it from the info cache
Nov 10 11:54:42 user nova-compute[74889]: DEBUG nova.network.neutron [req-572342d8-49d6-41c0-96b8-6c8cc972c4d3 req-43f75e69-11e8-4029-8fd3-0d88adb585ae service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-572342d8-49d6-41c0-96b8-6c8cc972c4d3 req-43f75e69-11e8-4029-8fd3-0d88adb585ae service nova] [instance: 330f6b5b-9e60-42bf-be67-981a13e29ef4] Detach interface failed, port_id=84a0b161-daed-42f6-8f9f-61cacf7c4798, reason: Instance 330f6b5b-9e60-42bf-be67-981a13e29ef4 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:54:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:42 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Deleted allocations for instance 330f6b5b-9e60-42bf-be67-981a13e29ef4
Nov 10 11:54:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b4f996b2-af98-4124-ae10-d85c843a465a tempest-VolumesAssistedSnapshotsTest-540390099 tempest-VolumesAssistedSnapshotsTest-540390099-project-member] Lock "330f6b5b-9e60-42bf-be67-981a13e29ef4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.076s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received event network-vif-plugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] Lock "81cfb431-3aee-4081-82ba-49612a294d61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] Lock "81cfb431-3aee-4081-82ba-49612a294d61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] No waiting events found dispatching network-vif-plugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:54:43 user nova-compute[74889]: WARNING nova.compute.manager [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received unexpected event network-vif-plugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad for instance with vm_state building and task_state spawning.
Nov 10 11:54:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received event network-vif-plugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:54:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:54:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] Lock "81cfb431-3aee-4081-82ba-49612a294d61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:54:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] Lock "81cfb431-3aee-4081-82ba-49612a294d61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] No waiting events found dispatching network-vif-plugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:54:43 user nova-compute[74889]: WARNING nova.compute.manager [req-bf27a50c-1733-463c-b613-10cc30479fa9 req-03c6050d-153e-492d-b2c8-eccc56676a9c service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received unexpected event network-vif-plugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad for instance with vm_state building and task_state spawning.
Nov 10 11:54:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:54:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:54:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Instance spawned successfully.
Nov 10 11:54:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:54:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:54:44 user nova-compute[74889]: INFO nova.compute.manager [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Took 11.11 seconds to spawn the instance on the hypervisor.
Nov 10 11:54:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:54:44 user nova-compute[74889]: INFO nova.compute.manager [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Took 12.54 seconds to build instance.
Nov 10 11:54:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ce1dface-bed1-40f1-a387-953048593784 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.806s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:54:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:54:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-ba6ebcbe-9047-4d68-b709-9fa8779a579b req-9cf269a6-598d-48f3-acbe-6150b9486432 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event volume-reimaged-83e12811-d82a-4e65-a0b1-b4c84ecad9e3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:55:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ba6ebcbe-9047-4d68-b709-9fa8779a579b req-9cf269a6-598d-48f3-acbe-6150b9486432 service nova] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:55:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ba6ebcbe-9047-4d68-b709-9fa8779a579b req-9cf269a6-598d-48f3-acbe-6150b9486432 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:55:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ba6ebcbe-9047-4d68-b709-9fa8779a579b req-9cf269a6-598d-48f3-acbe-6150b9486432 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:55:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-ba6ebcbe-9047-4d68-b709-9fa8779a579b req-9cf269a6-598d-48f3-acbe-6150b9486432 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Processing event volume-reimaged-83e12811-d82a-4e65-a0b1-b4c84ecad9e3 {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 10 11:55:07 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Instance event wait completed in 48 seconds for volume-reimaged {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:55:08 user nova-compute[74889]: INFO nova.virt.block_device [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Booting with volume 83e12811-d82a-4e65-a0b1-b4c84ecad9e3 at /dev/vda
Nov 10 11:55:08 user nova-compute[74889]: DEBUG os_brick.utils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d26934-8aff-4a02-8074-5425ca548b39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6edc1ae-0c15-47bc-91d0-8ec02200c342]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb374e5-9a31-4ec7-bbb9-54f71f7253cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8540eee-366b-4629-8a9c-d23063bccc46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:55:08 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:55:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab86c52-8642-4e58-91d9-9a6beb48b0b0]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG os_brick.utils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Updating existing volume attachment record: aab19a2c-baea-4616-a088-850e4927a582 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:55:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjAtDHYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62224c8d-72a9-449a-ab5b-376197157c3e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'serial': 'a6f39e4b-de0e-4f77-8ad4-3c61538b2707'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHrLOZzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'd64b752b-be20-46ed-b790-dce922ccdd57'}, 'status': 'reserved', 'instance': '62224c8d-72a9-449a-ab5b-376197157c3e', 'attached_at': '', 'detached_at': '', 'volume_id': 'd64b752b-be20-46ed-b790-dce922ccdd57', 'serial'} {{(pid=74889) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquired lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG nova.network.neutron [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'info_cache' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjAtDHYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:55:21 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:55:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:55:21 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:55:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:55:21 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb5aff0-a398-4a37-8e7c-a7e090982f34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:55:21 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77074a9-8807-4652-b4ca-b63267d25e4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707] added
Nov 10 11:55:21 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG nova.objects.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2e544c-2647-4fb1-b0f8-99ee4cdb4c43]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea98f7fd-388e-4c2d-b18c-6914048b1991]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjAtDHYU {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zjAtDHYU" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e42042-ba70-403e-b470-d8bc2af96842]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zjAtDHYU'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f126bf3-e1f9-4601-b007-3b6b709be0ce]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9396b2-7c1d-48f5-89e7-a0749808f0ad]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:22 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:22 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:22 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:22 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG nova.network.neutron [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updating instance_info_cache with network_info: [{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Releasing lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:55:22 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance destroyed successfully.
Nov 10 11:55:22 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'resources' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG nova.objects.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-518100689',display_name='tempest-AttachVolumeTestJSON-server-518100689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-518100689',id=2,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEh76cZ/xflXBEdMOROgxqbhG35Jz0cqE4YYKJiGcf50O8aLCm2o2DfUHmGwzHJW0DU1jZ0rVUpQW2CmcsWOI30JbHZMThJB6IQjvv8CUUQ6Nrn1BLEBG5jDbyobMxuOg==',key_name='tempest-keypair-1235958409',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-ngy0se22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=527ef5ba-c67a-481a-b835-e8b6196f3902,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG os_vif [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b2c7fdc-3f, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31cbdc5a-5324-45ac-a55a-c57725be1496) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:22 user nova-compute[74889]: INFO os_vif [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f')
Nov 10 11:55:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:55:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJRCNbgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:55:22 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:55:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --login" returned: 0 in 1.228s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a923bd3f-ae39-46dc-ac64-7dc3b4d93fd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260]
Nov 10 11:55:23 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260] successful.
Nov 10 11:55:23 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e062ecdd-ef8e-4cd0-a235-37a9a1f13893]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efb03f0-faf5-4014-b759-8cb6eaab3c2f]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:23 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:23 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:23 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:23 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:23 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:23 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.517s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] HCTL ('35', '-', '-', 0) found on session 9 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9d9ff2-6886-48b9-8aa8-68243918f3bd]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Searching for a device in session 9 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:55:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjAtDHYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.555s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] <== connect_volume: return (2557ms) {'type': 'block', 'scsi_wwn': '26663633830353431', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663633830353431', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.794s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lazy-loading 'flavor' on Instance uuid 62224c8d-72a9-449a-ab5b-376197157c3e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[290969eb-105c-44fe-981c-23848c237a52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:55:24 user nova-compute[74889]: No targets found.
Nov 10 11:55:24 user nova-compute[74889]: iSNS:
Nov 10 11:55:24 user nova-compute[74889]: No targets found.
Nov 10 11:55:24 user nova-compute[74889]: STATIC:
Nov 10 11:55:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:55:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:55:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:55:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707
Nov 10 11:55:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:55:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:55:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57
Nov 10 11:55:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:55:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:55:24 user nova-compute[74889]: FIRMWARE:
Nov 10 11:55:24 user nova-compute[74889]: No targets found.
Nov 10 11:55:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:55:24 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:55:24 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ec0dca-c323-4945-890c-e0ab13b52d10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[67869919-a0c6-45f6-ade1-c67cd4834464]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:24 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:24 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:24 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:24 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398205ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de'): ({'sdc'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Removing single pathed devices sdc {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fc3267-20fa-4c00-8279-30efda99c150]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[81206c77-10d0-4d77-894d-853dc00d2c6c]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flushing IO for device /dev/sdc {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a973518-a0c1-42e3-9366-2731830b87f8]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9593cac-2a35-42b1-b23e-f6af8c888405]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[288dbf1d-ff0f-42be-8dc4-5a8f5b3e4597]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6384eab8-740b-43ba-baa8-e5ff82ce6425]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260]
Nov 10 11:55:24 user nova-compute[74889]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260] successful.
Nov 10 11:55:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e4f13c-d301-44e2-bc7e-95d7b4cbee5b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== disconnect_volume: return (2158ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Start _get_guest_xml network_info=[{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJRCNbgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '527ef5ba-c67a-481a-b835-e8b6196f3902', 'attached_at': '', 'detached_at': '', 'volume_id': '54c47476-ac7b-496c-87b5-70b24843f2de', 'serial': '54c47476-ac7b-496c-87b5-70b24843f2de'}, 'disk_bus': 'virtio', 'attachment_id': 'dd3a9c73-0488-4d59-92b0-600a74bcfcbb', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'numa_topology' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.objects.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:55:24 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:55:24 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'vcpu_model' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.objects.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJRCNbgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:55:24 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:55:24 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:55:24 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c16403d-0f5e-414f-9fef-be946ce0506a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:55:24 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[03221271-2bb8-4b6e-93c6-c8128f7bf841]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de] added
Nov 10 11:55:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b1ca71-39a9-41db-af79-3d2e6cce913b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ab61a8-fec1-45ec-9290-a88168e6ad74]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJRCNbgu {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJRCNbgu" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83f7373-ee84-48a2-b518-02cd41633187]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fJRCNbgu'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab186627-efab-491e-9af4-343c128d2373]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ded630-fe03-458c-8ccf-60750c7eccc1]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:25 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:25 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[da936478-daa7-4cb2-901a-8765e03480d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260]
Nov 10 11:55:25 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260] successful.
Nov 10 11:55:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00f9204-37c9-4f98-9aee-f30e76fa91c0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2907e084-7bdc-4884-9d69-e35a722e7f16]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:25 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:25 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:25 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:25 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.424s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[286b63ad-95c4-4465-99a6-0f5ba1010450]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 152043520 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:55:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 328204288 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJRCNbgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23635333738353738', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635333738353738', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-518100689',display_name='tempest-AttachVolumeTestJSON-server-518100689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-518100689',id=2,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEh76cZ/xflXBEdMOROgxqbhG35Jz0cqE4YYKJiGcf50O8aLCm2o2DfUHmGwzHJW0DU1jZ0rVUpQW2CmcsWOI30JbHZMThJB6IQjvv8CUUQ6Nrn1BLEBG5jDbyobMxuOg==',key_name='tempest-keypair-1235958409',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-ngy0se22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=527ef5ba-c67a-481a-b835-e8b6196f3902,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'pci_devices' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 459276288 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.objects.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:55:26 user nova-compute[74889]:   <uuid>527ef5ba-c67a-481a-b835-e8b6196f3902</uuid>
Nov 10 11:55:26 user nova-compute[74889]:   <name>instance-00000002</name>
Nov 10 11:55:26 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:55:26 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:55:26 user nova-compute[74889]:   <metadata>
Nov 10 11:55:26 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:55:26 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:55:26 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeTestJSON-server-518100689</nova:name>
Nov 10 11:55:26 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:55:24</nova:creationTime>
Nov 10 11:55:26 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:55:26 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:55:26 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:55:26 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:55:26 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:55:26 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:55:26 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:55:26 user nova-compute[74889]:       <nova:owner>
Nov 10 11:55:26 user nova-compute[74889]:         <nova:user uuid="9dd24986fbd2446dbb8f5fbc7edb1757">tempest-AttachVolumeTestJSON-1611590837-project-member</nova:user>
Nov 10 11:55:26 user nova-compute[74889]:         <nova:project uuid="eeabeb4c529647f296feb83801c04f34">tempest-AttachVolumeTestJSON-1611590837</nova:project>
Nov 10 11:55:26 user nova-compute[74889]:       </nova:owner>
Nov 10 11:55:26 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:55:26 user nova-compute[74889]:       <nova:ports>
Nov 10 11:55:26 user nova-compute[74889]:         <nova:port uuid="5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50">
Nov 10 11:55:26 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 11:55:26 user nova-compute[74889]:         </nova:port>
Nov 10 11:55:26 user nova-compute[74889]:       </nova:ports>
Nov 10 11:55:26 user nova-compute[74889]:     </nova:instance>
Nov 10 11:55:26 user nova-compute[74889]:   </metadata>
Nov 10 11:55:26 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:55:26 user nova-compute[74889]:     <system>
Nov 10 11:55:26 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:55:26 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:55:26 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:55:26 user nova-compute[74889]:       <entry name="serial">527ef5ba-c67a-481a-b835-e8b6196f3902</entry>
Nov 10 11:55:26 user nova-compute[74889]:       <entry name="uuid">527ef5ba-c67a-481a-b835-e8b6196f3902</entry>
Nov 10 11:55:26 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:55:26 user nova-compute[74889]:     </system>
Nov 10 11:55:26 user nova-compute[74889]:   </sysinfo>
Nov 10 11:55:26 user nova-compute[74889]:   <os>
Nov 10 11:55:26 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:55:26 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:55:26 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:55:26 user nova-compute[74889]:   </os>
Nov 10 11:55:26 user nova-compute[74889]:   <features>
Nov 10 11:55:26 user nova-compute[74889]:     <acpi/>
Nov 10 11:55:26 user nova-compute[74889]:     <apic/>
Nov 10 11:55:26 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:55:26 user nova-compute[74889]:   </features>
Nov 10 11:55:26 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:55:26 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:55:26 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:55:26 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:55:26 user nova-compute[74889]:   </clock>
Nov 10 11:55:26 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:55:26 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:55:26 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:55:26 user nova-compute[74889]:   </cpu>
Nov 10 11:55:26 user nova-compute[74889]:   <devices>
Nov 10 11:55:26 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:55:26 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:55:26 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk"/>
Nov 10 11:55:26 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:55:26 user nova-compute[74889]:     </disk>
Nov 10 11:55:26 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 11:55:26 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:55:26 user nova-compute[74889]:       <source dev="/dev/sdc"/>
Nov 10 11:55:26 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 11:55:26 user nova-compute[74889]:       <serial>54c47476-ac7b-496c-87b5-70b24843f2de</serial>
Nov 10 11:55:26 user nova-compute[74889]:     </disk>
Nov 10 11:55:26 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:55:26 user nova-compute[74889]:       <mac address="fa:16:3e:84:97:e7"/>
Nov 10 11:55:26 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:55:26 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:55:26 user nova-compute[74889]:       <target dev="tap5b2c7fdc-3f"/>
Nov 10 11:55:26 user nova-compute[74889]:     </interface>
Nov 10 11:55:26 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:55:26 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/console.log" append="off"/>
Nov 10 11:55:26 user nova-compute[74889]:     </serial>
Nov 10 11:55:26 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:55:26 user nova-compute[74889]:     <video>
Nov 10 11:55:26 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:55:26 user nova-compute[74889]:     </video>
Nov 10 11:55:26 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:55:26 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:55:26 user nova-compute[74889]:     </rng>
Nov 10 11:55:26 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:55:26 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:55:26 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:55:26 user nova-compute[74889]:     </memballoon>
Nov 10 11:55:26 user nova-compute[74889]:   </devices>
Nov 10 11:55:26 user nova-compute[74889]: </domain>
Nov 10 11:55:26 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'trusted_certs' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.objects.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 618659840 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Cannot resize image /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'migration_context' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG nova.objects.base [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-518100689',display_name='tempest-AttachVolumeTestJSON-server-518100689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-518100689',id=2,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEh76cZ/xflXBEdMOROgxqbhG35Jz0cqE4YYKJiGcf50O8aLCm2o2DfUHmGwzHJW0DU1jZ0rVUpQW2CmcsWOI30JbHZMThJB6IQjvv8CUUQ6Nrn1BLEBG5jDbyobMxuOg==',key_name='tempest-keypair-1235958409',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-ngy0se22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=527ef5ba-c67a-481a-b835-e8b6196f3902,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG os_vif [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7ce74a7-78d6-5377-b2df-ef36d135d0bf', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b2c7fdc-3f, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b2c7fdc-3f, col_values=(('qos', UUID('13eb4932-dd01-444e-8794-ea7a386461ab')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b2c7fdc-3f, col_values=(('external_ids', {'iface-id': '5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:97:e7', 'vm-uuid': '527ef5ba-c67a-481a-b835-e8b6196f3902'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:27 user nova-compute[74889]: INFO os_vif [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f')
Nov 10 11:55:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 787480576 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:55:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 929038336 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHrLOZzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'd64b752b-be20-46ed-b790-dce922ccdd57'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:55:28 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b73ca6e-f232-4706-8527-e2eac24f9930]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:55:28 user nova-compute[74889]: No targets found.
Nov 10 11:55:28 user nova-compute[74889]: iSNS:
Nov 10 11:55:28 user nova-compute[74889]: No targets found.
Nov 10 11:55:28 user nova-compute[74889]: STATIC:
Nov 10 11:55:28 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:55:28 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:55:28 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:55:28 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707
Nov 10 11:55:28 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:55:28 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:55:28 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57
Nov 10 11:55:28 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:55:28 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:55:28 user nova-compute[74889]: FIRMWARE:
Nov 10 11:55:28 user nova-compute[74889]: No targets found.
Nov 10 11:55:28 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:55:28 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:55:28 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1239c71e-47ad-44d8-bdad-593662e50283]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f6bc6-73de-4e56-8737-b12628ed24a9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:28 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:28 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:28 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:28 user nova-compute[74889]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 (non-flash)
Nov 10 11:55:28 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:28 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a0091e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4b54c6-6307-407b-967c-731edcc5ec00]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf95727b-3b9c-4d75-8bb4-3be3a8ecacd7]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af14fba-1679-4222-ab87-0058ec0607e6]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18ca9cd-857e-467c-815a-f24e36592843]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a36a05-fb89-4e1a-965a-6401faf13c58]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce47bfed-397e-4940-95f2-8abf1a9e0b79]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57, portal: 172.16.0.220,3260]
Nov 10 11:55:29 user nova-compute[74889]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57, portal: 172.16.0.220,3260] successful.
Nov 10 11:55:29 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64b752b-be20-46ed-b790-dce922ccdd57 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[27464d90-206e-4e87-ad88-f5d9df204d02]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] <== disconnect_volume: return (356ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjAtDHYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '62224c8d-72a9-449a-ab5b-376197157c3e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'serial'} {{(pid=74889) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] swap_volume: removing Cinder connection for volume d64b752b-be20-46ed-b790-dce922ccdd57 {{(pid=74889) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-01a0cc02-9ba2-4745-866e-851de38dfb25 req-88df5e7c-a114-421d-8053-04b7a4bfedf5 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-01a0cc02-9ba2-4745-866e-851de38dfb25 req-88df5e7c-a114-421d-8053-04b7a4bfedf5 service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-01a0cc02-9ba2-4745-866e-851de38dfb25 req-88df5e7c-a114-421d-8053-04b7a4bfedf5 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-01a0cc02-9ba2-4745-866e-851de38dfb25 req-88df5e7c-a114-421d-8053-04b7a4bfedf5 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-01a0cc02-9ba2-4745-866e-851de38dfb25 req-88df5e7c-a114-421d-8053-04b7a4bfedf5 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:55:29 user nova-compute[74889]: WARNING nova.compute.manager [req-01a0cc02-9ba2-4745-866e-851de38dfb25 req-88df5e7c-a114-421d-8053-04b7a4bfedf5 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state stopped and task_state powering-on.
Nov 10 11:55:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:55:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:55:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:55:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:55:30 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:55:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-2cf8518c-f6f1-48ad-85ae-3f49a0ae627e req-115e2990-4272-4ef3-bbb8-2cf1345a6c94 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2cf8518c-f6f1-48ad-85ae-3f49a0ae627e req-115e2990-4272-4ef3-bbb8-2cf1345a6c94 service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2cf8518c-f6f1-48ad-85ae-3f49a0ae627e req-115e2990-4272-4ef3-bbb8-2cf1345a6c94 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2cf8518c-f6f1-48ad-85ae-3f49a0ae627e req-115e2990-4272-4ef3-bbb8-2cf1345a6c94 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-2cf8518c-f6f1-48ad-85ae-3f49a0ae627e req-115e2990-4272-4ef3-bbb8-2cf1345a6c94 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:55:31 user nova-compute[74889]: WARNING nova.compute.manager [req-2cf8518c-f6f1-48ad-85ae-3f49a0ae627e req-115e2990-4272-4ef3-bbb8-2cf1345a6c94 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state stopped and task_state powering-on.
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:55:31 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance rebooted successfully.
Nov 10 11:55:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4ef1ae21-bcca-46d7-b82e-36f0fe3b4729 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:55:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:34 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:55:34 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7996MB free_disk=25.618011474609375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 133007ba-7922-43b9-babc-4e32bd0dcb1f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 62224c8d-72a9-449a-ab5b-376197157c3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6200554d-5be6-48b4-90e9-4151006d8ce3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance ff790962-c708-465c-a240-36748871cfda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 81cfb431-3aee-4081-82ba-49612a294d61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:55:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:55:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:55:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:55:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:55:38 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:55:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:55:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:55:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:55:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 11:55:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Updating instance_info_cache with network_info: [{"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:55:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-62224c8d-72a9-449a-ab5b-376197157c3e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:55:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 11:55:40 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:55:40 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:55:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:55:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:55:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:55:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:42 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] swap_volume: Updating volume d64b752b-be20-46ed-b790-dce922ccdd57 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "zjAtDHYU", "auth_password": "xWRKdXht8rzve3", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "a6f39e4b-de0e-4f77-8ad4-3c61538b2707"}, "status": "reserved", "instance": "62224c8d-72a9-449a-ab5b-376197157c3e", "attached_at": "", "detached_at": "", "volume_id": "a6f39e4b-de0e-4f77-8ad4-3c61538b2707", "serial": "a6f39e4b-de0e-4f77-8ad4-3c61538b2707"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'no_device': None, 'attachment_id': 'db676993-9cce-4d30-8224-fc74fff8ba46'} {{(pid=74889) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 10 11:55:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4fbb5337-e6c6-48a2-9143-67c865c03e4c tempest-TestVolumeSwap-556459509 tempest-TestVolumeSwap-556459509-project-admin] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 61.162s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:55:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:55:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:55:43 user nova-compute[74889]: INFO nova.compute.manager [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Detaching volume a6f39e4b-de0e-4f77-8ad4-3c61538b2707
Nov 10 11:55:43 user nova-compute[74889]: INFO nova.virt.block_device [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Attempting to driver detach volume a6f39e4b-de0e-4f77-8ad4-3c61538b2707 from mountpoint /dev/vdb
Nov 10 11:55:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Attempting to detach device vdb from instance 62224c8d-72a9-449a-ab5b-376197157c3e from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 11:55:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:55:43 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:55:43 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:55:43 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:55:43 user nova-compute[74889]:   <serial>a6f39e4b-de0e-4f77-8ad4-3c61538b2707</serial>
Nov 10 11:55:43 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 11:55:43 user nova-compute[74889]: </disk>
Nov 10 11:55:43 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:55:43 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Successfully detached device vdb from instance 62224c8d-72a9-449a-ab5b-376197157c3e from the persistent domain config.
Nov 10 11:55:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62224c8d-72a9-449a-ab5b-376197157c3e from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 11:55:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:55:43 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:55:43 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:55:43 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:55:43 user nova-compute[74889]:   <serial>a6f39e4b-de0e-4f77-8ad4-3c61538b2707</serial>
Nov 10 11:55:43 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 11:55:43 user nova-compute[74889]: </disk>
Nov 10 11:55:43 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62224c8d-72a9-449a-ab5b-376197157c3e {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:55:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Creating image(s)
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Ensure instance console log exists: /opt/stack/data/nova/instances/54fa74ec-d37c-4517-8f83-9ea1f23c1cc4/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Start _get_guest_xml network_info=[{"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQcnwRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54fa74ec-d37c-4517-8f83-9ea1f23c1cc4', 'attached_at': '', 'detached_at': '', 'volume_id': '83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'serial': '83e12811-d82a-4e65-a0b1-b4c84ecad9e3'}, 'disk_bus': 'virtio', 'attachment_id': 'aab19a2c-baea-4616-a088-850e4927a582', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:55:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 11:55:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lazy-loading 'vcpu_model' on Instance uuid 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQcnwRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:55:44 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:55:44 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:55:44 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[826091ec-f277-4322-b584-3213d91dd8a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:55:44 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fe8229-7793-4116-91ca-4aaca370325a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3] added
Nov 10 11:55:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.074s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e014cadc-dc8f-465a-87f4-8ce9f6bee7d7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8c5228-c30b-48fc-b0b2-e22e2ecb6084]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrQcnwRI {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qrQcnwRI" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d4dc13-0c46-44c4-b320-3f116c6f2abb]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qrQcnwRI'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cbf631-4249-44a1-a8fc-fbe597b83d4d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fa1467-9c64-49e2-b170-a89f6b251855]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:44 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:44 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[516a9dae-f508-4bed-ad2e-9ef473cefd60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260]
Nov 10 11:55:44 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260] successful.
Nov 10 11:55:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f87f8d-ae36-4dbc-926e-996ed9d6f3e9]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fa4146-30eb-4877-b7b7-59e123a3db49]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:44 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:55:44 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:55:44 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:55:44 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:55:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c05962c-d128-44b8-9526-64b60de9ead2]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:55:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQcnwRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '26666613766363831', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666613766363831', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T11:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1990135163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-868336549',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0uHLQXQj7dInSfVC9TaIgqa+9RQkjH42pg0qSxOcSGwGx0kYhgRvc39hCLN0H5L4IYuYHZeUvD0cEK5tcx4IArwdZ7cEmkvJUn/s+QbltOH4DHvllrCcGkdiSwTNa9tg==',key_name='tempest-keypair-27701663',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c0db768727f4544865ec53756cf5e4f',ramdisk_id='',reservation_id='r-3vgvinwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1329161327',owner_user_name='tempest-ServerActionsV293TestJSON-1329161327-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82bd448d0c3045aeb1114169f1a952b9',uuid=54fa74ec-d37c-4517-8f83-9ea1f23c1cc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converting VIF {"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:55:45 user nova-compute[74889]:   <uuid>54fa74ec-d37c-4517-8f83-9ea1f23c1cc4</uuid>
Nov 10 11:55:45 user nova-compute[74889]:   <name>instance-00000007</name>
Nov 10 11:55:45 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:55:45 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:55:45 user nova-compute[74889]:   <metadata>
Nov 10 11:55:45 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:55:45 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:55:45 user nova-compute[74889]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1990135163</nova:name>
Nov 10 11:55:45 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:55:44</nova:creationTime>
Nov 10 11:55:45 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:55:45 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:55:45 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:55:45 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:55:45 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:55:45 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:55:45 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:55:45 user nova-compute[74889]:       <nova:owner>
Nov 10 11:55:45 user nova-compute[74889]:         <nova:user uuid="82bd448d0c3045aeb1114169f1a952b9">tempest-ServerActionsV293TestJSON-1329161327-project-member</nova:user>
Nov 10 11:55:45 user nova-compute[74889]:         <nova:project uuid="9c0db768727f4544865ec53756cf5e4f">tempest-ServerActionsV293TestJSON-1329161327</nova:project>
Nov 10 11:55:45 user nova-compute[74889]:       </nova:owner>
Nov 10 11:55:45 user nova-compute[74889]:       <nova:ports>
Nov 10 11:55:45 user nova-compute[74889]:         <nova:port uuid="da93881f-7f2f-401e-8dcd-a881954e3905">
Nov 10 11:55:45 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 11:55:45 user nova-compute[74889]:         </nova:port>
Nov 10 11:55:45 user nova-compute[74889]:       </nova:ports>
Nov 10 11:55:45 user nova-compute[74889]:     </nova:instance>
Nov 10 11:55:45 user nova-compute[74889]:   </metadata>
Nov 10 11:55:45 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:55:45 user nova-compute[74889]:     <system>
Nov 10 11:55:45 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:55:45 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:55:45 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:55:45 user nova-compute[74889]:       <entry name="serial">54fa74ec-d37c-4517-8f83-9ea1f23c1cc4</entry>
Nov 10 11:55:45 user nova-compute[74889]:       <entry name="uuid">54fa74ec-d37c-4517-8f83-9ea1f23c1cc4</entry>
Nov 10 11:55:45 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:55:45 user nova-compute[74889]:     </system>
Nov 10 11:55:45 user nova-compute[74889]:   </sysinfo>
Nov 10 11:55:45 user nova-compute[74889]:   <os>
Nov 10 11:55:45 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:55:45 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:55:45 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:55:45 user nova-compute[74889]:   </os>
Nov 10 11:55:45 user nova-compute[74889]:   <features>
Nov 10 11:55:45 user nova-compute[74889]:     <acpi/>
Nov 10 11:55:45 user nova-compute[74889]:     <apic/>
Nov 10 11:55:45 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:55:45 user nova-compute[74889]:   </features>
Nov 10 11:55:45 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:55:45 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:55:45 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:55:45 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:55:45 user nova-compute[74889]:   </clock>
Nov 10 11:55:45 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:55:45 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:55:45 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:55:45 user nova-compute[74889]:   </cpu>
Nov 10 11:55:45 user nova-compute[74889]:   <devices>
Nov 10 11:55:45 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 11:55:45 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:55:45 user nova-compute[74889]:       <source dev="/dev/sdb"/>
Nov 10 11:55:45 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:55:45 user nova-compute[74889]:       <serial>83e12811-d82a-4e65-a0b1-b4c84ecad9e3</serial>
Nov 10 11:55:45 user nova-compute[74889]:     </disk>
Nov 10 11:55:45 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:55:45 user nova-compute[74889]:       <mac address="fa:16:3e:95:7d:80"/>
Nov 10 11:55:45 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:55:45 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:55:45 user nova-compute[74889]:       <target dev="tapda93881f-7f"/>
Nov 10 11:55:45 user nova-compute[74889]:     </interface>
Nov 10 11:55:45 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:55:45 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/54fa74ec-d37c-4517-8f83-9ea1f23c1cc4/console.log" append="off"/>
Nov 10 11:55:45 user nova-compute[74889]:     </serial>
Nov 10 11:55:45 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:55:45 user nova-compute[74889]:     <video>
Nov 10 11:55:45 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:55:45 user nova-compute[74889]:     </video>
Nov 10 11:55:45 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:55:45 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:55:45 user nova-compute[74889]:     </rng>
Nov 10 11:55:45 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:55:45 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:55:45 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:55:45 user nova-compute[74889]:     </memballoon>
Nov 10 11:55:45 user nova-compute[74889]:   </devices>
Nov 10 11:55:45 user nova-compute[74889]: </domain>
Nov 10 11:55:45 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T11:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1990135163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-868336549',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0uHLQXQj7dInSfVC9TaIgqa+9RQkjH42pg0qSxOcSGwGx0kYhgRvc39hCLN0H5L4IYuYHZeUvD0cEK5tcx4IArwdZ7cEmkvJUn/s+QbltOH4DHvllrCcGkdiSwTNa9tg==',key_name='tempest-keypair-27701663',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9c0db768727f4544865ec53756cf5e4f',ramdisk_id='',reservation_id='r-3vgvinwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1329161327',owner_user_name='tempest-ServerActionsV293TestJSON-1329161327-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:55:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82bd448d0c3045aeb1114169f1a952b9',uuid=54fa74ec-d37c-4517-8f83-9ea1f23c1cc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converting VIF {"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG os_vif [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f5f6a4b-f0e5-5761-8d74-a7fbfed44564', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda93881f-7f, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda93881f-7f, col_values=(('qos', UUID('2b4f43eb-ec23-4ec6-af51-1222a801ac43')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda93881f-7f, col_values=(('external_ids', {'iface-id': 'da93881f-7f2f-401e-8dcd-a881954e3905', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:7d:80', 'vm-uuid': '54fa74ec-d37c-4517-8f83-9ea1f23c1cc4'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:55:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:45 user nova-compute[74889]: INFO os_vif [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f')
Nov 10 11:55:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:55:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] No VIF found with MAC fa:16:3e:95:7d:80, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:55:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-eb008d7a-7620-476d-b443-9c1f43f3008b req-da05525b-4197-420d-960d-b9b581bb6a36 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:55:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-eb008d7a-7620-476d-b443-9c1f43f3008b req-da05525b-4197-420d-960d-b9b581bb6a36 service nova] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:55:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-eb008d7a-7620-476d-b443-9c1f43f3008b req-da05525b-4197-420d-960d-b9b581bb6a36 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:55:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-eb008d7a-7620-476d-b443-9c1f43f3008b req-da05525b-4197-420d-960d-b9b581bb6a36 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:55:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-eb008d7a-7620-476d-b443-9c1f43f3008b req-da05525b-4197-420d-960d-b9b581bb6a36 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] No waiting events found dispatching network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:55:48 user nova-compute[74889]: WARNING nova.compute.manager [req-eb008d7a-7620-476d-b443-9c1f43f3008b req-da05525b-4197-420d-960d-b9b581bb6a36 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received unexpected event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 11:55:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:55:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:55:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Instance spawned successfully.
Nov 10 11:55:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:55:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:55:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:55:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:55:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:55:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:55:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:55:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:55:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:55:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:55:50 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74889) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 11:55:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-c1c2e106-5d30-49d8-a7cd-3db78d19627b req-96891a3a-d9c0-42fb-9e84-0c89a42005b3 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:55:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1c2e106-5d30-49d8-a7cd-3db78d19627b req-96891a3a-d9c0-42fb-9e84-0c89a42005b3 service nova] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:55:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1c2e106-5d30-49d8-a7cd-3db78d19627b req-96891a3a-d9c0-42fb-9e84-0c89a42005b3 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:55:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1c2e106-5d30-49d8-a7cd-3db78d19627b req-96891a3a-d9c0-42fb-9e84-0c89a42005b3 service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:55:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-c1c2e106-5d30-49d8-a7cd-3db78d19627b req-96891a3a-d9c0-42fb-9e84-0c89a42005b3 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] No waiting events found dispatching network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:55:50 user nova-compute[74889]: WARNING nova.compute.manager [req-c1c2e106-5d30-49d8-a7cd-3db78d19627b req-96891a3a-d9c0-42fb-9e84-0c89a42005b3 service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received unexpected event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 for instance with vm_state active and task_state None.
Nov 10 11:55:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba6ebcbe-9047-4d68-b709-9fa8779a579b tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.115s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:55:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:55:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 62224c8d-72a9-449a-ab5b-376197157c3e is timed out.
Nov 10 11:56:04 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Successfully detached device vdb from instance 62224c8d-72a9-449a-ab5b-376197157c3e from the live domain config.
Nov 10 11:56:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zjAtDHYU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'a6f39e4b-de0e-4f77-8ad4-3c61538b2707'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:56:04 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd68e78e-21f2-4a89-aefc-79ad53127ba8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:56:04 user nova-compute[74889]: No targets found.
Nov 10 11:56:04 user nova-compute[74889]: iSNS:
Nov 10 11:56:04 user nova-compute[74889]: No targets found.
Nov 10 11:56:04 user nova-compute[74889]: STATIC:
Nov 10 11:56:04 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:56:04 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:56:04 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:56:04 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707
Nov 10 11:56:04 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:56:04 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:56:04 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3
Nov 10 11:56:04 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:56:04 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:56:04 user nova-compute[74889]: FIRMWARE:
Nov 10 11:56:04 user nova-compute[74889]: No targets found.
Nov 10 11:56:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:56:04 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:56:04 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[56325ff5-36d0-4314-8cec-a31978d23be5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd691ada-252e-499d-8726-cc05d697abda]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:04 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:04 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:56:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:04 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:04 user nova-compute[74889]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 (non-flash)
Nov 10 11:56:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a03d5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[25751826-86bb-4d01-b826-9991b67c444a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[82827a60-7b2b-43e6-8acf-95d58c22dc59]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2addaee2-aa8f-4940-a7ac-6062017bc232]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9a21d4-f490-411a-8047-6f3fa46cb5c5]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f93d972-a625-486c-9f9e-e426dd78b7bf]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5b7899-1f16-4906-95ee-ea379649e958]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260]
Nov 10 11:56:04 user nova-compute[74889]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707, portal: 172.16.0.220,3260] successful.
Nov 10 11:56:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6f39e4b-de0e-4f77-8ad4-3c61538b2707 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba77c601-c260-48f1-b899-116e18b26b71]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] <== disconnect_volume: return (369ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:56:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:56:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:56:06 user nova-compute[74889]: INFO nova.compute.claims [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Claim successful on node user
Nov 10 11:56:06 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lazy-loading 'flavor' on Instance uuid 62224c8d-72a9-449a-ab5b-376197157c3e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6701cbe0-7d2c-40ad-857f-8e662863c4b2 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.142s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:56:06 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:56:06 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:56:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.policy [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd028f217bd5b4a3994139d537c623bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f4a33c330842ba9dca41b5a174a07d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:56:07 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Creating image(s)
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "/opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "/opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "/opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-74acd0b3-2bbf-4d99-b9f2-3de40e2d213b req-51a89829-9150-47c7-b375-b942f44354a4 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received event network-changed-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-74acd0b3-2bbf-4d99-b9f2-3de40e2d213b req-51a89829-9150-47c7-b375-b942f44354a4 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Refreshing instance network info cache due to event network-changed-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-74acd0b3-2bbf-4d99-b9f2-3de40e2d213b req-51a89829-9150-47c7-b375-b942f44354a4 service nova] Acquiring lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-74acd0b3-2bbf-4d99-b9f2-3de40e2d213b req-51a89829-9150-47c7-b375-b942f44354a4 service nova] Acquired lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-74acd0b3-2bbf-4d99-b9f2-3de40e2d213b req-51a89829-9150-47c7-b375-b942f44354a4 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Refreshing network info cache for port b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.211s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.199s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk 1073741824" returned: 0 in 0.066s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.objects.instance [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lazy-loading 'flavor' on Instance uuid 6200554d-5be6-48b4-90e9-4151006d8ce3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-74acd0b3-2bbf-4d99-b9f2-3de40e2d213b req-51a89829-9150-47c7-b375-b942f44354a4 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updated VIF entry in instance network info cache for port b40bb580-99e7-4ca8-a45e-cd332d4e4cd7. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-74acd0b3-2bbf-4d99-b9f2-3de40e2d213b req-51a89829-9150-47c7-b375-b942f44354a4 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updating instance_info_cache with network_info: [{"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-74acd0b3-2bbf-4d99-b9f2-3de40e2d213b req-51a89829-9150-47c7-b375-b942f44354a4 service nova] Releasing lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Successfully created port: ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.212s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:07 user nova-compute[74889]: INFO nova.compute.manager [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Attaching volume c4babeff-1ec7-43f2-bc6c-c759827fb207 to /dev/vdb
Nov 10 11:56:08 user nova-compute[74889]: DEBUG os_brick.utils [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Cannot resize image /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Ensure instance console log exists: /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15a2181-d880-4f64-8d66-8024c0f64172]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf81e2-8b32-41c3-a693-d131acf55606]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fa0f3a-f47a-4db0-9934-4f3e86e3de05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[600bc8f9-7a35-46e5-a79a-9c6925095980]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:56:08 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d12d6-6a65-4b2a-a1d1-1822605e7f29]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG os_brick.utils [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updating existing volume attachment record: 4103a383-cce2-4c3c-8851-a8bbaf75b54a {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Successfully updated port: ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-565f0281-a8c2-4d6c-866f-7f23d4e4bf9e req-65828363-e894-45a0-b1a5-3ddf20eceb5f service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received event network-changed-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-565f0281-a8c2-4d6c-866f-7f23d4e4bf9e req-65828363-e894-45a0-b1a5-3ddf20eceb5f service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Refreshing instance network info cache due to event network-changed-ea862be1-a0e1-4e74-9464-9cfb4201f611. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-565f0281-a8c2-4d6c-866f-7f23d4e4bf9e req-65828363-e894-45a0-b1a5-3ddf20eceb5f service nova] Acquiring lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-565f0281-a8c2-4d6c-866f-7f23d4e4bf9e req-65828363-e894-45a0-b1a5-3ddf20eceb5f service nova] Acquired lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG nova.network.neutron [req-565f0281-a8c2-4d6c-866f-7f23d4e4bf9e req-65828363-e894-45a0-b1a5-3ddf20eceb5f service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Refreshing network info cache for port ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG nova.network.neutron [req-565f0281-a8c2-4d6c-866f-7f23d4e4bf9e req-65828363-e894-45a0-b1a5-3ddf20eceb5f service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:56:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.network.neutron [req-565f0281-a8c2-4d6c-866f-7f23d4e4bf9e req-65828363-e894-45a0-b1a5-3ddf20eceb5f service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-565f0281-a8c2-4d6c-866f-7f23d4e4bf9e req-65828363-e894-45a0-b1a5-3ddf20eceb5f service nova] Releasing lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquired lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Updating instance_info_cache with network_info: [{"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Releasing lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Instance network_info: |[{"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Start _get_guest_xml network_info=[{"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:56:09 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:56:09 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-334584636',display_name='tempest-VolumesAdminNegativeTest-server-334584636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-334584636',id=11,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH0CR8juMjTeJIa38UPLor6e8vvtvsVJ8AUm9XirzmjX31zD8KQdFkm+BKMngPY2Bx6lKGDAIFV23Dwra3h3q890WkkMHBl6DX1dtxzfcvsTFr62pTybPdx0EWt+6Wu6w==',key_name='tempest-keypair-335841088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74f4a33c330842ba9dca41b5a174a07d',ramdisk_id='',reservation_id='r-tleex7z6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-35604331',owner_user_name='tempest-VolumesAdminNegativeTest-35604331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028f217bd5b4a3994139d537c623bc5',uuid=61077e59-6249-4a6e-b749-733ed9735bb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converting VIF {"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=ea862be1-a0e1-4e74-9464-9cfb4201f611,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea862be1-a0') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lazy-loading 'pci_devices' on Instance uuid 61077e59-6249-4a6e-b749-733ed9735bb2 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:56:09 user nova-compute[74889]:   <uuid>61077e59-6249-4a6e-b749-733ed9735bb2</uuid>
Nov 10 11:56:09 user nova-compute[74889]:   <name>instance-0000000b</name>
Nov 10 11:56:09 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:56:09 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:56:09 user nova-compute[74889]:   <metadata>
Nov 10 11:56:09 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:56:09 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:56:09 user nova-compute[74889]:       <nova:name>tempest-VolumesAdminNegativeTest-server-334584636</nova:name>
Nov 10 11:56:09 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:56:09</nova:creationTime>
Nov 10 11:56:09 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:56:09 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:56:09 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:56:09 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:56:09 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:56:09 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:56:09 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:56:09 user nova-compute[74889]:       <nova:owner>
Nov 10 11:56:09 user nova-compute[74889]:         <nova:user uuid="d028f217bd5b4a3994139d537c623bc5">tempest-VolumesAdminNegativeTest-35604331-project-member</nova:user>
Nov 10 11:56:09 user nova-compute[74889]:         <nova:project uuid="74f4a33c330842ba9dca41b5a174a07d">tempest-VolumesAdminNegativeTest-35604331</nova:project>
Nov 10 11:56:09 user nova-compute[74889]:       </nova:owner>
Nov 10 11:56:09 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:56:09 user nova-compute[74889]:       <nova:ports>
Nov 10 11:56:09 user nova-compute[74889]:         <nova:port uuid="ea862be1-a0e1-4e74-9464-9cfb4201f611">
Nov 10 11:56:09 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 11:56:09 user nova-compute[74889]:         </nova:port>
Nov 10 11:56:09 user nova-compute[74889]:       </nova:ports>
Nov 10 11:56:09 user nova-compute[74889]:     </nova:instance>
Nov 10 11:56:09 user nova-compute[74889]:   </metadata>
Nov 10 11:56:09 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:56:09 user nova-compute[74889]:     <system>
Nov 10 11:56:09 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:56:09 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:56:09 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:56:09 user nova-compute[74889]:       <entry name="serial">61077e59-6249-4a6e-b749-733ed9735bb2</entry>
Nov 10 11:56:09 user nova-compute[74889]:       <entry name="uuid">61077e59-6249-4a6e-b749-733ed9735bb2</entry>
Nov 10 11:56:09 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:56:09 user nova-compute[74889]:     </system>
Nov 10 11:56:09 user nova-compute[74889]:   </sysinfo>
Nov 10 11:56:09 user nova-compute[74889]:   <os>
Nov 10 11:56:09 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:56:09 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:56:09 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:56:09 user nova-compute[74889]:   </os>
Nov 10 11:56:09 user nova-compute[74889]:   <features>
Nov 10 11:56:09 user nova-compute[74889]:     <acpi/>
Nov 10 11:56:09 user nova-compute[74889]:     <apic/>
Nov 10 11:56:09 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:56:09 user nova-compute[74889]:   </features>
Nov 10 11:56:09 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:56:09 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:56:09 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:56:09 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:56:09 user nova-compute[74889]:   </clock>
Nov 10 11:56:09 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:56:09 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:56:09 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:56:09 user nova-compute[74889]:   </cpu>
Nov 10 11:56:09 user nova-compute[74889]:   <devices>
Nov 10 11:56:09 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:56:09 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:56:09 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk"/>
Nov 10 11:56:09 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:56:09 user nova-compute[74889]:     </disk>
Nov 10 11:56:09 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:56:09 user nova-compute[74889]:       <mac address="fa:16:3e:69:9b:10"/>
Nov 10 11:56:09 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:56:09 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:56:09 user nova-compute[74889]:       <target dev="tapea862be1-a0"/>
Nov 10 11:56:09 user nova-compute[74889]:     </interface>
Nov 10 11:56:09 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:56:09 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/console.log" append="off"/>
Nov 10 11:56:09 user nova-compute[74889]:     </serial>
Nov 10 11:56:09 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:56:09 user nova-compute[74889]:     <video>
Nov 10 11:56:09 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:56:09 user nova-compute[74889]:     </video>
Nov 10 11:56:09 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:56:09 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:56:09 user nova-compute[74889]:     </rng>
Nov 10 11:56:09 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:56:09 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:56:09 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:56:09 user nova-compute[74889]:     </memballoon>
Nov 10 11:56:09 user nova-compute[74889]:   </devices>
Nov 10 11:56:09 user nova-compute[74889]: </domain>
Nov 10 11:56:09 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-334584636',display_name='tempest-VolumesAdminNegativeTest-server-334584636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-334584636',id=11,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH0CR8juMjTeJIa38UPLor6e8vvtvsVJ8AUm9XirzmjX31zD8KQdFkm+BKMngPY2Bx6lKGDAIFV23Dwra3h3q890WkkMHBl6DX1dtxzfcvsTFr62pTybPdx0EWt+6Wu6w==',key_name='tempest-keypair-335841088',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74f4a33c330842ba9dca41b5a174a07d',ramdisk_id='',reservation_id='r-tleex7z6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-35604331',owner_user_name='tempest-VolumesAdminNegativeTest-35604331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:56:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028f217bd5b4a3994139d537c623bc5',uuid=61077e59-6249-4a6e-b749-733ed9735bb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converting VIF {"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=ea862be1-a0e1-4e74-9464-9cfb4201f611,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea862be1-a0') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG os_vif [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=ea862be1-a0e1-4e74-9464-9cfb4201f611,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea862be1-a0') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0dbd254f-e1ea-511c-ba1b-241656396f12', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea862be1-a0, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea862be1-a0, col_values=(('qos', UUID('1fcb2022-fb73-415e-8bf1-a02d924292fc')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea862be1-a0, col_values=(('external_ids', {'iface-id': 'ea862be1-a0e1-4e74-9464-9cfb4201f611', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:9b:10', 'vm-uuid': '61077e59-6249-4a6e-b749-733ed9735bb2'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:09 user nova-compute[74889]: INFO os_vif [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=ea862be1-a0e1-4e74-9464-9cfb4201f611,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea862be1-a0')
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:56:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] No VIF found with MAC fa:16:3e:69:9b:10, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:56:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-e817b126-caf4-49f0-bf6a-2a5ab594f7b3 req-259e1965-3b54-4da0-9221-5cb8bde34862 service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received event network-vif-plugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e817b126-caf4-49f0-bf6a-2a5ab594f7b3 req-259e1965-3b54-4da0-9221-5cb8bde34862 service nova] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e817b126-caf4-49f0-bf6a-2a5ab594f7b3 req-259e1965-3b54-4da0-9221-5cb8bde34862 service nova] Lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e817b126-caf4-49f0-bf6a-2a5ab594f7b3 req-259e1965-3b54-4da0-9221-5cb8bde34862 service nova] Lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-e817b126-caf4-49f0-bf6a-2a5ab594f7b3 req-259e1965-3b54-4da0-9221-5cb8bde34862 service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] No waiting events found dispatching network-vif-plugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:56:11 user nova-compute[74889]: WARNING nova.compute.manager [req-e817b126-caf4-49f0-bf6a-2a5ab594f7b3 req-259e1965-3b54-4da0-9221-5cb8bde34862 service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received unexpected event network-vif-plugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 for instance with vm_state building and task_state spawning.
Nov 10 11:56:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-28a16ae8-f038-4102-b54b-ee064f15b0d5 req-8cc7dd71-e308-4cf5-bb58-1da7463ba2ac service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received event network-vif-plugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-28a16ae8-f038-4102-b54b-ee064f15b0d5 req-8cc7dd71-e308-4cf5-bb58-1da7463ba2ac service nova] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-28a16ae8-f038-4102-b54b-ee064f15b0d5 req-8cc7dd71-e308-4cf5-bb58-1da7463ba2ac service nova] Lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-28a16ae8-f038-4102-b54b-ee064f15b0d5 req-8cc7dd71-e308-4cf5-bb58-1da7463ba2ac service nova] Lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-28a16ae8-f038-4102-b54b-ee064f15b0d5 req-8cc7dd71-e308-4cf5-bb58-1da7463ba2ac service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] No waiting events found dispatching network-vif-plugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:56:13 user nova-compute[74889]: WARNING nova.compute.manager [req-28a16ae8-f038-4102-b54b-ee064f15b0d5 req-8cc7dd71-e308-4cf5-bb58-1da7463ba2ac service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received unexpected event network-vif-plugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 for instance with vm_state building and task_state spawning.
Nov 10 11:56:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:56:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:56:14 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Instance spawned successfully.
Nov 10 11:56:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:56:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:56:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:56:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:56:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:56:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:56:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:56:14 user nova-compute[74889]: INFO nova.compute.manager [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Took 7.26 seconds to spawn the instance on the hypervisor.
Nov 10 11:56:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:56:14 user nova-compute[74889]: INFO nova.compute.manager [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Took 8.20 seconds to build instance.
Nov 10 11:56:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7df13748-5f8a-481f-ad7c-e4c4dbfec6b7 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.335s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-314e1169-6a53-4e3f-88c8-52c97be02e8f req-fb465b4b-179f-438b-a413-a2ad819ac0c1 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-changed-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-314e1169-6a53-4e3f-88c8-52c97be02e8f req-fb465b4b-179f-438b-a413-a2ad819ac0c1 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Refreshing instance network info cache due to event network-changed-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-314e1169-6a53-4e3f-88c8-52c97be02e8f req-fb465b4b-179f-438b-a413-a2ad819ac0c1 service nova] Acquiring lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-314e1169-6a53-4e3f-88c8-52c97be02e8f req-fb465b4b-179f-438b-a413-a2ad819ac0c1 service nova] Acquired lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG nova.network.neutron [req-314e1169-6a53-4e3f-88c8-52c97be02e8f req-fb465b4b-179f-438b-a413-a2ad819ac0c1 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Refreshing network info cache for port 9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "ff790962-c708-465c-a240-36748871cfda" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG nova.objects.instance [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'flavor' on Instance uuid ff790962-c708-465c-a240-36748871cfda {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG nova.network.neutron [req-314e1169-6a53-4e3f-88c8-52c97be02e8f req-fb465b4b-179f-438b-a413-a2ad819ac0c1 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Updated VIF entry in instance network info cache for port 9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG nova.network.neutron [req-314e1169-6a53-4e3f-88c8-52c97be02e8f req-fb465b4b-179f-438b-a413-a2ad819ac0c1 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Updating instance_info_cache with network_info: [{"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-314e1169-6a53-4e3f-88c8-52c97be02e8f req-fb465b4b-179f-438b-a413-a2ad819ac0c1 service nova] Releasing lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:56:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "ff790962-c708-465c-a240-36748871cfda" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:20 user nova-compute[74889]: INFO nova.compute.manager [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Attaching volume b2f008cc-bb29-47ea-acbb-e97402d482b9 to /dev/vdb
Nov 10 11:56:20 user nova-compute[74889]: DEBUG os_brick.utils [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05ad592-4e2b-4b05-92ad-f5ee94d0b11d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a93adf-0d82-4dfc-aab6-651825224629]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb834f4-bc14-4bf1-9b40-6018b0b960ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc73a90-abe0-414f-ace3-d3ec333d46f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:56:20 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:56:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f43549-2d15-4cf5-93da-ba31f7906432]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG os_brick.utils [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:56:20 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Updating existing volume attachment record: 8f95f627-d8e6-4bc2-89e5-94584964662e {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:56:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-f2fd7847-a8d7-4ee4-8f3e-ecdb5cb8e5ab req-0e47259b-8ef4-415c-a29d-349f044dc0df service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received event network-changed-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-f2fd7847-a8d7-4ee4-8f3e-ecdb5cb8e5ab req-0e47259b-8ef4-415c-a29d-349f044dc0df service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Refreshing instance network info cache due to event network-changed-c63694e5-beaf-49f0-9dab-7bde0d79d1ad. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:56:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f2fd7847-a8d7-4ee4-8f3e-ecdb5cb8e5ab req-0e47259b-8ef4-415c-a29d-349f044dc0df service nova] Acquiring lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:56:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f2fd7847-a8d7-4ee4-8f3e-ecdb5cb8e5ab req-0e47259b-8ef4-415c-a29d-349f044dc0df service nova] Acquired lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:56:22 user nova-compute[74889]: DEBUG nova.network.neutron [req-f2fd7847-a8d7-4ee4-8f3e-ecdb5cb8e5ab req-0e47259b-8ef4-415c-a29d-349f044dc0df service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Refreshing network info cache for port c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.007s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:23 user nova-compute[74889]: INFO nova.compute.manager [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Terminating instance
Nov 10 11:56:23 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-8545e216-45a5-4945-b9c4-009c30a0c983 req-30ab2c97-2fea-45cd-8193-6087a6ed35b4 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received event network-vif-unplugged-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8545e216-45a5-4945-b9c4-009c30a0c983 req-30ab2c97-2fea-45cd-8193-6087a6ed35b4 service nova] Acquiring lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8545e216-45a5-4945-b9c4-009c30a0c983 req-30ab2c97-2fea-45cd-8193-6087a6ed35b4 service nova] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8545e216-45a5-4945-b9c4-009c30a0c983 req-30ab2c97-2fea-45cd-8193-6087a6ed35b4 service nova] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-8545e216-45a5-4945-b9c4-009c30a0c983 req-30ab2c97-2fea-45cd-8193-6087a6ed35b4 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] No waiting events found dispatching network-vif-unplugged-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-8545e216-45a5-4945-b9c4-009c30a0c983 req-30ab2c97-2fea-45cd-8193-6087a6ed35b4 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received event network-vif-unplugged-9c692175-8e5b-4186-b654-169463411093 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:23 user nova-compute[74889]: DEBUG nova.objects.instance [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lazy-loading 'flavor' on Instance uuid 81cfb431-3aee-4081-82ba-49612a294d61 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG nova.network.neutron [req-f2fd7847-a8d7-4ee4-8f3e-ecdb5cb8e5ab req-0e47259b-8ef4-415c-a29d-349f044dc0df service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Updated VIF entry in instance network info cache for port c63694e5-beaf-49f0-9dab-7bde0d79d1ad. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG nova.network.neutron [req-f2fd7847-a8d7-4ee4-8f3e-ecdb5cb8e5ab req-0e47259b-8ef4-415c-a29d-349f044dc0df service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Updating instance_info_cache with network_info: [{"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Instance destroyed successfully.
Nov 10 11:56:24 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lazy-loading 'resources' on Instance uuid 133007ba-7922-43b9-babc-4e32bd0dcb1f {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f2fd7847-a8d7-4ee4-8f3e-ecdb5cb8e5ab req-0e47259b-8ef4-415c-a29d-349f044dc0df service nova] Releasing lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:50:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-403710932',display_name='tempest-AttachSCSIVolumeTestJSON-server-403710932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-403710932',id=4,image_ref='acf5b0a4-99b0-4569-b39f-e59bcd9383eb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHM75RrC5nApOj2YPB9B1Mv5sVmRnmkVj66dQe/Vq4BKc9az1bySWoDRZ1+unImAEuSNnpM2nXi/O+WG8lAuO2qq3XO42vwk2lzLhWWafemNxWDFmbg6/RYinP5pWc8uHQ==',key_name='tempest-keypair-582329993',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:51:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='869f808d49da47e2a1fd50043a85cd2d',ramdisk_id='',reservation_id='r-wqs415hp',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='acf5b0a4-99b0-4569-b39f-e59bcd9383eb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-254135104',owner_user_name='tempest-AttachSCSIVolumeTestJSON-254135104-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8849d2da16fa406ba5db2b5995dfa172',uuid=133007ba-7922-43b9-babc-4e32bd0dcb1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Converting VIF {"id": "9c692175-8e5b-4186-b654-169463411093", "address": "fa:16:3e:aa:3d:42", "network": {"id": "c13ac228-5f2f-4683-90f7-df4d9313c9b2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906460169-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "869f808d49da47e2a1fd50043a85cd2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c692175-8e", "ovs_interfaceid": "9c692175-8e5b-4186-b654-169463411093", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:3d:42,bridge_name='br-int',has_traffic_filtering=True,id=9c692175-8e5b-4186-b654-169463411093,network=Network(c13ac228-5f2f-4683-90f7-df4d9313c9b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c692175-8e') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG os_vif [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:3d:42,bridge_name='br-int',has_traffic_filtering=True,id=9c692175-8e5b-4186-b654-169463411093,network=Network(c13ac228-5f2f-4683-90f7-df4d9313c9b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c692175-8e') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c692175-8e, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47894edd-dca9-4bd7-bb7b-8458b0c38cc5) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:56:24 user nova-compute[74889]: INFO os_vif [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:3d:42,bridge_name='br-int',has_traffic_filtering=True,id=9c692175-8e5b-4186-b654-169463411093,network=Network(c13ac228-5f2f-4683-90f7-df4d9313c9b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c692175-8e')
Nov 10 11:56:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Deleting instance files /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f_del
Nov 10 11:56:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Deletion of /opt/stack/data/nova/instances/133007ba-7922-43b9-babc-4e32bd0dcb1f_del complete
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:24 user nova-compute[74889]: INFO nova.compute.manager [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Attaching volume f9d58b72-227e-4817-a687-b415e8574584 to /dev/vdb
Nov 10 11:56:24 user nova-compute[74889]: INFO nova.compute.manager [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG os_brick.utils [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebf21aa-0e5e-4c6c-a460-3f1c0c9cf257]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ac3db5-47cd-419f-a049-49a6f12cd1ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b94f241-97da-4a81-b449-0d7789edc26e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac66ba42-795d-48b1-acc1-064339b36dbb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:56:24 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:56:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21d9f81-b06c-47ec-8ec1-bb9afa0d18f2]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG os_brick.utils [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:56:24 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Updating existing volume attachment record: bcbffc2f-ea2e-485d-9886-8ea1f2307cd2 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:56:25 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:56:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-5724042b-2052-443b-a2dd-82b842ab5614 req-3328183e-a6f7-4495-9a0b-5e12a15633d9 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received event network-vif-deleted-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:25 user nova-compute[74889]: INFO nova.compute.manager [req-5724042b-2052-443b-a2dd-82b842ab5614 req-3328183e-a6f7-4495-9a0b-5e12a15633d9 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Neutron deleted interface 9c692175-8e5b-4186-b654-169463411093; detaching it from the instance and deleting it from the info cache
Nov 10 11:56:25 user nova-compute[74889]: DEBUG nova.network.neutron [req-5724042b-2052-443b-a2dd-82b842ab5614 req-3328183e-a6f7-4495-9a0b-5e12a15633d9 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:56:25 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Took 1.24 seconds to deallocate network for instance.
Nov 10 11:56:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-5724042b-2052-443b-a2dd-82b842ab5614 req-3328183e-a6f7-4495-9a0b-5e12a15633d9 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Detach interface failed, port_id=9c692175-8e5b-4186-b654-169463411093, reason: Instance 133007ba-7922-43b9-babc-4e32bd0dcb1f could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 11:56:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-a31c6679-c6e2-457e-bf06-5109dfaa7cbe req-0282b33f-a200-42de-bc6c-fc56e33dbe75 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received event network-vif-plugged-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a31c6679-c6e2-457e-bf06-5109dfaa7cbe req-0282b33f-a200-42de-bc6c-fc56e33dbe75 service nova] Acquiring lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a31c6679-c6e2-457e-bf06-5109dfaa7cbe req-0282b33f-a200-42de-bc6c-fc56e33dbe75 service nova] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a31c6679-c6e2-457e-bf06-5109dfaa7cbe req-0282b33f-a200-42de-bc6c-fc56e33dbe75 service nova] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-a31c6679-c6e2-457e-bf06-5109dfaa7cbe req-0282b33f-a200-42de-bc6c-fc56e33dbe75 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] No waiting events found dispatching network-vif-plugged-9c692175-8e5b-4186-b654-169463411093 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:56:25 user nova-compute[74889]: WARNING nova.compute.manager [req-a31c6679-c6e2-457e-bf06-5109dfaa7cbe req-0282b33f-a200-42de-bc6c-fc56e33dbe75 service nova] [instance: 133007ba-7922-43b9-babc-4e32bd0dcb1f] Received unexpected event network-vif-plugged-9c692175-8e5b-4186-b654-169463411093 for instance with vm_state deleted and task_state None.
Nov 10 11:56:26 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:56:26 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:56:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.557s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:26 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Deleted allocations for instance 133007ba-7922-43b9-babc-4e32bd0dcb1f
Nov 10 11:56:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fa791e0-1dc8-4990-a404-7a8feff63894 tempest-AttachSCSIVolumeTestJSON-254135104 tempest-AttachSCSIVolumeTestJSON-254135104-project-member] Lock "133007ba-7922-43b9-babc-4e32bd0dcb1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.120s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:56:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:56:35 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:56:35 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:56:35 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7666MB free_disk=25.60440444946289GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:56:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 62224c8d-72a9-449a-ab5b-376197157c3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6200554d-5be6-48b4-90e9-4151006d8ce3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance ff790962-c708-465c-a240-36748871cfda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 81cfb431-3aee-4081-82ba-49612a294d61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 61077e59-6249-4a6e-b749-733ed9735bb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDWHitkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:56:36 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:56:36 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:56:36 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f368d2-e88b-4276-be21-ed5376ba95c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:56:36 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a83f3b-f44f-48e5-9e99-23db56ae9adf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207] added
Nov 10 11:56:36 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7a4226-a792-4919-8e00-b6d069781403]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb07efe-8c34-48ee-ae5f-12444803e4fe]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDWHitkv {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDWHitkv" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d4da3c-16e4-4c85-86ba-a9c85dbbaae5]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TDWHitkv'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8b157b-0b29-4ce2-8a29-ca3efc9aac83]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d426c41-a3da-46b2-919e-e6cf643e522c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:36 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:36 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:36 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:36 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:56:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4b1173-3c4d-4149-b679-0eebac9dc0ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207, portal: 172.16.0.220,3260]
Nov 10 11:56:37 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207, portal: 172.16.0.220,3260] successful.
Nov 10 11:56:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b163d02-5faa-42dc-b9a0-8df6f6a15fd3]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b15ae23-35bf-4a48-aa0f-de1689591985]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:37 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:37 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:37 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:37 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[688d111a-aa02-406a-957e-3f9f59965d56]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDWHitkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:37 user nova-compute[74889]: INFO nova.compute.manager [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Terminating instance
Nov 10 11:56:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 11:56:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23730313161306337', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730313161306337', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lazy-loading 'flavor' on Instance uuid 6200554d-5be6-48b4-90e9-4151006d8ce3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 11:56:38 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:56:38 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:56:38 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:56:38 user nova-compute[74889]:   <serial>c4babeff-1ec7-43f2-bc6c-c759827fb207</serial>
Nov 10 11:56:38 user nova-compute[74889]: </disk>
Nov 10 11:56:38 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-c0cedbc2-21c6-459c-aec2-b7c169eace3e req-ddd7c0f8-4a54-4d89-b03a-8b72ad861fd6 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received event network-vif-unplugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c0cedbc2-21c6-459c-aec2-b7c169eace3e req-ddd7c0f8-4a54-4d89-b03a-8b72ad861fd6 service nova] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c0cedbc2-21c6-459c-aec2-b7c169eace3e req-ddd7c0f8-4a54-4d89-b03a-8b72ad861fd6 service nova] Lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c0cedbc2-21c6-459c-aec2-b7c169eace3e req-ddd7c0f8-4a54-4d89-b03a-8b72ad861fd6 service nova] Lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-c0cedbc2-21c6-459c-aec2-b7c169eace3e req-ddd7c0f8-4a54-4d89-b03a-8b72ad861fd6 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] No waiting events found dispatching network-vif-unplugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-c0cedbc2-21c6-459c-aec2-b7c169eace3e req-ddd7c0f8-4a54-4d89-b03a-8b72ad861fd6 service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received event network-vif-unplugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Skipping network cache update for instance because it is being deleted. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] No VIF found with MAC fa:16:3e:3f:30:b8, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:38 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Instance destroyed successfully.
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lazy-loading 'resources' on Instance uuid 62224c8d-72a9-449a-ab5b-376197157c3e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:51:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-106218730',display_name='tempest-TestVolumeSwap-server-106218730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-106218730',id=6,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU5wPeUeVohvI0vZVD7C9+8n7jRnNsPWKCqS4cekrg0OqZ2ROg7QXhARlmCm1JKFKfAIJ6joB1SKAZeyJdZE3Cx7unFhPAp16aHQ/AgBx5Tki1uUucG4EuFgvDPuoVR8Q==',key_name='tempest-keypair-1297191324',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:51:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2a54fb5d501431ea3386ebb82603036',ramdisk_id='',reservation_id='r-08dxjhgl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-316523943',owner_user_name='tempest-TestVolumeSwap-316523943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5894f3d255b24f478b4a7587af72e78f',uuid=62224c8d-72a9-449a-ab5b-376197157c3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Converting VIF {"id": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "address": "fa:16:3e:4e:fb:1d", "network": {"id": "8aedc35e-710b-417f-a155-721b994769b0", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1085932523-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2a54fb5d501431ea3386ebb82603036", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d5ab299-1a", "ovs_interfaceid": "7d5ab299-1af9-4966-ba6d-12e8ebe7087b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:fb:1d,bridge_name='br-int',has_traffic_filtering=True,id=7d5ab299-1af9-4966-ba6d-12e8ebe7087b,network=Network(8aedc35e-710b-417f-a155-721b994769b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5ab299-1a') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG os_vif [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:fb:1d,bridge_name='br-int',has_traffic_filtering=True,id=7d5ab299-1af9-4966-ba6d-12e8ebe7087b,network=Network(8aedc35e-710b-417f-a155-721b994769b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5ab299-1a') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d5ab299-1a, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=625cc0e4-7625-485a-85fc-8bc96164caaa) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:56:38 user nova-compute[74889]: INFO os_vif [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:fb:1d,bridge_name='br-int',has_traffic_filtering=True,id=7d5ab299-1af9-4966-ba6d-12e8ebe7087b,network=Network(8aedc35e-710b-417f-a155-721b994769b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d5ab299-1a')
Nov 10 11:56:38 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Deleting instance files /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e_del
Nov 10 11:56:38 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Deletion of /opt/stack/data/nova/instances/62224c8d-72a9-449a-ab5b-376197157c3e_del complete
Nov 10 11:56:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-22e9549b-10e5-4f3b-b328-5fc87e2974a5 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.059s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:39 user nova-compute[74889]: INFO nova.compute.manager [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 10 11:56:39 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 11:56:39 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 11:56:39 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 11:56:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updating instance_info_cache with network_info: [{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:56:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:56:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 11:56:39 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:39 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 11:56:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-18ac3daa-799b-4878-bf5d-02b18799f56d req-f885dc30-15d9-4df1-b412-9d4d2c63d1ec service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received event network-vif-plugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-18ac3daa-799b-4878-bf5d-02b18799f56d req-f885dc30-15d9-4df1-b412-9d4d2c63d1ec service nova] Acquiring lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-18ac3daa-799b-4878-bf5d-02b18799f56d req-f885dc30-15d9-4df1-b412-9d4d2c63d1ec service nova] Lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-18ac3daa-799b-4878-bf5d-02b18799f56d req-f885dc30-15d9-4df1-b412-9d4d2c63d1ec service nova] Lock "62224c8d-72a9-449a-ab5b-376197157c3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-18ac3daa-799b-4878-bf5d-02b18799f56d req-f885dc30-15d9-4df1-b412-9d4d2c63d1ec service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] No waiting events found dispatching network-vif-plugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:56:40 user nova-compute[74889]: WARNING nova.compute.manager [req-18ac3daa-799b-4878-bf5d-02b18799f56d req-f885dc30-15d9-4df1-b412-9d4d2c63d1ec service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received unexpected event network-vif-plugged-7d5ab299-1af9-4966-ba6d-12e8ebe7087b for instance with vm_state active and task_state deleting.
Nov 10 11:56:40 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:56:40 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Took 1.51 seconds to deallocate network for instance.
Nov 10 11:56:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-ba820879-e1ef-4552-abf7-acb5ac5ab418 req-dbf8af9d-455b-4a86-82d8-929bd9b6dd3e service nova] [instance: 62224c8d-72a9-449a-ab5b-376197157c3e] Received event network-vif-deleted-7d5ab299-1af9-4966-ba6d-12e8ebe7087b {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:41 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Deleted allocations for instance 62224c8d-72a9-449a-ab5b-376197157c3e
Nov 10 11:56:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-82a88351-e786-42bf-9494-5bbfbae72303 tempest-TestVolumeSwap-316523943 tempest-TestVolumeSwap-316523943-project-member] Lock "62224c8d-72a9-449a-ab5b-376197157c3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.420s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:41 user nova-compute[74889]: INFO nova.compute.manager [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Detaching volume c4babeff-1ec7-43f2-bc6c-c759827fb207
Nov 10 11:56:41 user nova-compute[74889]: INFO nova.virt.block_device [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Attempting to driver detach volume c4babeff-1ec7-43f2-bc6c-c759827fb207 from mountpoint /dev/vdb
Nov 10 11:56:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Attempting to detach device vdb from instance 6200554d-5be6-48b4-90e9-4151006d8ce3 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:56:41 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:56:41 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:56:41 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:56:41 user nova-compute[74889]:   <serial>c4babeff-1ec7-43f2-bc6c-c759827fb207</serial>
Nov 10 11:56:41 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 11:56:41 user nova-compute[74889]: </disk>
Nov 10 11:56:41 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:56:41 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Successfully detached device vdb from instance 6200554d-5be6-48b4-90e9-4151006d8ce3 from the persistent domain config.
Nov 10 11:56:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6200554d-5be6-48b4-90e9-4151006d8ce3 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 11:56:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:56:41 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:56:41 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:56:41 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:56:41 user nova-compute[74889]:   <serial>c4babeff-1ec7-43f2-bc6c-c759827fb207</serial>
Nov 10 11:56:41 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 11:56:41 user nova-compute[74889]: </disk>
Nov 10 11:56:41 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:56:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6200554d-5be6-48b4-90e9-4151006d8ce3 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 11:56:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:56:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJLxoOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:56:48 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:56:48 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:56:48 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[27146bfe-7860-4451-bbdc-0b45d0f3847b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:56:48 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac76f92-025d-4806-8bce-820342ff4f7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9] added
Nov 10 11:56:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb211b1c-4ba2-440b-a339-d151986cf05a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8693cd1-ecdf-4771-9549-1e8a1251c0f9]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJLxoOMG {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJLxoOMG" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce6306e-51a4-4a2f-ba22-b56d53ddd367]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJLxoOMG'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a349d032-ca77-4eea-942a-4181a3d4cd4b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[02954d86-576c-4006-bb3f-208325c5c291]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:48 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:48 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:48 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:48 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bea9fe-c13b-458c-a01f-9e57813d1ee1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260]
Nov 10 11:56:48 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260] successful.
Nov 10 11:56:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed3d851-486a-4be0-9802-c3d9e1fd2f81]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a588c860-07c3-4b02-9563-053517554e21]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:48 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:48 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:48 user nova-compute[74889]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:56:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:48 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:48 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:48 user nova-compute[74889]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:56:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:56:48 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:56:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[334d2d08-0bd9-4ec9-8322-e834ba55f106]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJLxoOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23630393238353436', 'path': '/dev/sde'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630393238353436', 'path': '/dev/sde'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG nova.objects.instance [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'flavor' on Instance uuid ff790962-c708-465c-a240-36748871cfda {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 11:56:50 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:56:50 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 11:56:50 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:56:50 user nova-compute[74889]:   <serial>b2f008cc-bb29-47ea-acbb-e97402d482b9</serial>
Nov 10 11:56:50 user nova-compute[74889]: </disk>
Nov 10 11:56:50 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No VIF found with MAC fa:16:3e:28:d7:7a, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:56:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-029d1ddc-2edb-4a76-af3e-b8a3a1419d7f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.926s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:52 user nova-compute[74889]: INFO nova.compute.manager [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Rebuilding instance
Nov 10 11:56:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:56:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:53 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: ff790962-c708-465c-a240-36748871cfda] Instance destroyed successfully.
Nov 10 11:56:53 user nova-compute[74889]: INFO nova.compute.manager [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Detaching volume b2f008cc-bb29-47ea-acbb-e97402d482b9
Nov 10 11:56:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:54 user nova-compute[74889]: INFO nova.virt.block_device [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Attempting to driver detach volume b2f008cc-bb29-47ea-acbb-e97402d482b9 from mountpoint /dev/vdb
Nov 10 11:56:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Attempting to detach device vdb from instance ff790962-c708-465c-a240-36748871cfda from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:56:54 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:56:54 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 11:56:54 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:56:54 user nova-compute[74889]:   <serial>b2f008cc-bb29-47ea-acbb-e97402d482b9</serial>
Nov 10 11:56:54 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 11:56:54 user nova-compute[74889]: </disk>
Nov 10 11:56:54 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:56:54 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully detached device vdb from instance ff790962-c708-465c-a240-36748871cfda from the persistent domain config.
Nov 10 11:56:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJLxoOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:56:54 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[55af4bf6-1f75-4e0e-8e0b-e646021ac641]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:56:54 user nova-compute[74889]: No targets found.
Nov 10 11:56:54 user nova-compute[74889]: iSNS:
Nov 10 11:56:54 user nova-compute[74889]: No targets found.
Nov 10 11:56:54 user nova-compute[74889]: STATIC:
Nov 10 11:56:54 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9
Nov 10 11:56:54 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:56:54 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:56:54 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:56:54 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:56:54 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:56:54 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207
Nov 10 11:56:54 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:56:54 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:56:54 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3
Nov 10 11:56:54 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:56:54 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:56:54 user nova-compute[74889]: FIRMWARE:
Nov 10 11:56:54 user nova-compute[74889]: No targets found.
Nov 10 11:56:54 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:56:54 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:56:54 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffeadac-0d33-4e5d-bc27-4b63a8b9c134]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6eb6bf-f2aa-4d48-972f-7a3f9d14a049]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:54 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:54 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:54 user nova-compute[74889]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:56:54 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:54 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:54 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:54 user nova-compute[74889]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:56:54 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a01d1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9'): ({'sde'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Removing single pathed devices sde {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abbf5ca-ded0-4e33-9e9d-812351508d56]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d015e4-585e-4f86-8fce-2d6af7e4a8ad]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flushing IO for device /dev/sde {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e323937-125e-490e-8dd8-6c37568dd121]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af7440d-d060-4721-8c49-ca455ea97413]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebea520-50cf-4600-8a51-ff25aada2996]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f68816-c5ef-4b7f-a6c3-976187446bf0]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260]
Nov 10 11:56:54 user nova-compute[74889]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260] successful.
Nov 10 11:56:54 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1080bb58-7a15-43cc-bdd8-d2ad3af854a9]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== disconnect_volume: return (363ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:56:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:56:55 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: ff790962-c708-465c-a240-36748871cfda] Instance destroyed successfully.
Nov 10 11:56:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-642189030',display_name='tempest-ServerActionsTestOtherA-server-273336335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-642189030',id=9,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0/XF+AB0GhusuxdUy4KCbA5BHH0mEXd6UsrJkBP5cRseQe4LcHZRtV1gX4Erce1ZdBd4lGhhKkzpZ8/b9Vm+ldnYnA6+7h9G9k9ev9qm8TXn29kna1Abvhrmq647o0WA==',key_name='tempest-keypair-958761505',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-fqz1x6s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:56:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=ff790962-c708-465c-a240-36748871cfda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_vif [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cf86e63-f9, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c32db711-ebdd-43a0-a9bd-c9148d8aac23) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:55 user nova-compute[74889]: INFO os_vif [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9')
Nov 10 11:56:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJLxoOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:56:55 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f55990-f423-436a-a3fb-8c71c195d602]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:56:55 user nova-compute[74889]: No targets found.
Nov 10 11:56:55 user nova-compute[74889]: iSNS:
Nov 10 11:56:55 user nova-compute[74889]: No targets found.
Nov 10 11:56:55 user nova-compute[74889]: STATIC:
Nov 10 11:56:55 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:56:55 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:56:55 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:56:55 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207
Nov 10 11:56:55 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:56:55 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:56:55 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3
Nov 10 11:56:55 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:56:55 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:56:55 user nova-compute[74889]: FIRMWARE:
Nov 10 11:56:55 user nova-compute[74889]: No targets found.
Nov 10 11:56:55 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:56:55 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:56:55 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf4d39-5111-49fa-9e65-a12d3ec3982b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[634daaf0-6d49-4b10-a5ff-4c79e679046c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:55 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:55 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:55 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:55 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:55 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:55 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a00741f0>, {}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Disconnecting from: [] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.072s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== disconnect_volume: return (74ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:56:55 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Deleting instance files /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda_del
Nov 10 11:56:55 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Deletion of /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda_del complete
Nov 10 11:56:55 user nova-compute[74889]: INFO nova.virt.block_device [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Booting with volume b2f008cc-bb29-47ea-acbb-e97402d482b9 at /dev/vdb
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.utils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[53924d01-4c35-4621-a59c-99f16f7368b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c82edb-9722-46c2-bfeb-9084153ebd44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a234f7-c2d8-40e1-bdbe-1a53e3af28fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a25595-3814-4e20-9e19-4b6c072a403e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:56:55 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:56:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b521be-bb29-4324-913d-050bd320c6df]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG os_brick.utils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:56:55 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Updating existing volume attachment record: 9057a8ed-3bf8-4fce-acf6-dc0c4bf84fc0 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:56:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-21fd47bb-613d-4ad4-986b-47d0ebfc6305 req-962c06b7-dfd5-47b9-b285-0ed31d2128a8 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-vif-unplugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-21fd47bb-613d-4ad4-986b-47d0ebfc6305 req-962c06b7-dfd5-47b9-b285-0ed31d2128a8 service nova] Acquiring lock "ff790962-c708-465c-a240-36748871cfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-21fd47bb-613d-4ad4-986b-47d0ebfc6305 req-962c06b7-dfd5-47b9-b285-0ed31d2128a8 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-21fd47bb-613d-4ad4-986b-47d0ebfc6305 req-962c06b7-dfd5-47b9-b285-0ed31d2128a8 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-21fd47bb-613d-4ad4-986b-47d0ebfc6305 req-962c06b7-dfd5-47b9-b285-0ed31d2128a8 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] No waiting events found dispatching network-vif-unplugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:56:56 user nova-compute[74889]: WARNING nova.compute.manager [req-21fd47bb-613d-4ad4-986b-47d0ebfc6305 req-962c06b7-dfd5-47b9-b285-0ed31d2128a8 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received unexpected event network-vif-unplugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 10 11:56:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FRgcABxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:56:57 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:56:57 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:56:57 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1671e45-f81c-4fd2-ac8e-eabd0f0e6b53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:56:57 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c8a515-c9dc-4a5b-95ca-f563d86a987a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584] added
Nov 10 11:56:57 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c776160-6efa-4cfc-b09f-932b3d0f3708]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ef791a-da31-4713-9986-cf60d2faf59a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FRgcABxD {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FRgcABxD" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c912b8f-ca5f-405f-870a-4dfab1fcf6b4]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FRgcABxD'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18543ce-dc00-4aa6-8638-816db6ea5516]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b90a83-91a3-470d-aaaa-1e4317b8420b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:57 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:57 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:57 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:57 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:57 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:57 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c270aa22-1486-4c2d-a8ab-56d5d350804e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584, portal: 172.16.0.220,3260]
Nov 10 11:56:57 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584, portal: 172.16.0.220,3260] successful.
Nov 10 11:56:57 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba999130-18be-4157-8691-8d8fe002e413]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[711add7a-f9e8-4d2d-9fa1-d8eeb3e30919]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:57 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:57 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:57 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:56:57 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:56:57 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:56:57 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:56:57 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:56:57 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb7c8b5-e438-4c2e-99e4-e1856a9612d9]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:56:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FRgcABxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-0f79c752-3980-4df4-a819-0109fc6f188a req-ef2de9ea-6a6c-47eb-be99-8b8b9a4fac29 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0f79c752-3980-4df4-a819-0109fc6f188a req-ef2de9ea-6a6c-47eb-be99-8b8b9a4fac29 service nova] Acquiring lock "ff790962-c708-465c-a240-36748871cfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0f79c752-3980-4df4-a819-0109fc6f188a req-ef2de9ea-6a6c-47eb-be99-8b8b9a4fac29 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0f79c752-3980-4df4-a819-0109fc6f188a req-ef2de9ea-6a6c-47eb-be99-8b8b9a4fac29 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-0f79c752-3980-4df4-a819-0109fc6f188a req-ef2de9ea-6a6c-47eb-be99-8b8b9a4fac29 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] No waiting events found dispatching network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:56:58 user nova-compute[74889]: WARNING nova.compute.manager [req-0f79c752-3980-4df4-a819-0109fc6f188a req-ef2de9ea-6a6c-47eb-be99-8b8b9a4fac29 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received unexpected event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 10 11:56:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23561666130663966', 'path': '/dev/sde'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561666130663966', 'path': '/dev/sde'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG nova.objects.instance [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lazy-loading 'flavor' on Instance uuid 81cfb431-3aee-4081-82ba-49612a294d61 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 11:56:58 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:56:58 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 11:56:58 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:56:58 user nova-compute[74889]:   <serial>f9d58b72-227e-4817-a687-b415e8574584</serial>
Nov 10 11:56:58 user nova-compute[74889]: </disk>
Nov 10 11:56:58 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:56:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:56:59 user nova-compute[74889]: INFO nova.compute.claims [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Claim successful on node user
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] No VIF found with MAC fa:16:3e:f4:9b:09, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-404f82a0-b70f-4a38-9eef-97d131591618 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.069s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:56:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.policy [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0a2bf1ce37a4d05b3179b2e8573c3e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c664edf4b1844ed9592c9f5851b4bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:56:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Creating image(s)
Nov 10 11:56:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "/opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "/opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "/opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:56:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk 1073741824" returned: 0 in 0.055s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:57:00 user nova-compute[74889]: INFO nova.compute.claims [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Claim successful on node user
Nov 10 11:57:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Cannot resize image /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Ensure instance console log exists: /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Successfully created port: 1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:57:00 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:57:01 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.policy [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f59a12b24b02408e9602dd7146453a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1298008035034b9ea352dc01af38a417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:57:01 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Creating image(s)
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "/opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "/opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "/opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "b1a121809d94d91e81c6dc9036889af227e00e06" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "b1a121809d94d91e81c6dc9036889af227e00e06" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06.part --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Successfully updated port: 1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-0412116f-3962-441d-89e0-9fc9668baac2 req-6f91bc72-b156-4ce5-a82a-c10275cf509f service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Received event network-changed-1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-0412116f-3962-441d-89e0-9fc9668baac2 req-6f91bc72-b156-4ce5-a82a-c10275cf509f service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Refreshing instance network info cache due to event network-changed-1ace983c-910d-402d-ad18-a7bad9021c70. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0412116f-3962-441d-89e0-9fc9668baac2 req-6f91bc72-b156-4ce5-a82a-c10275cf509f service nova] Acquiring lock "refresh_cache-8296720c-3b9e-4f86-8dfc-f4d7719a1a90" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0412116f-3962-441d-89e0-9fc9668baac2 req-6f91bc72-b156-4ce5-a82a-c10275cf509f service nova] Acquired lock "refresh_cache-8296720c-3b9e-4f86-8dfc-f4d7719a1a90" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.network.neutron [req-0412116f-3962-441d-89e0-9fc9668baac2 req-6f91bc72-b156-4ce5-a82a-c10275cf509f service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Refreshing network info cache for port 1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "refresh_cache-8296720c-3b9e-4f86-8dfc-f4d7719a1a90" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Successfully created port: 37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.network.neutron [req-0412116f-3962-441d-89e0-9fc9668baac2 req-6f91bc72-b156-4ce5-a82a-c10275cf509f service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06.part --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.virt.images [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] 67949d31-8d59-4baf-9c85-11bad7396a97 was qcow2, converting to raw {{(pid=74889) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 11:57:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06.part /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06.converted {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6200554d-5be6-48b4-90e9-4151006d8ce3 is timed out.
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06.part /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06.converted" returned: 0 in 0.209s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06.converted --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.neutron [req-0412116f-3962-441d-89e0-9fc9668baac2 req-6f91bc72-b156-4ce5-a82a-c10275cf509f service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:57:02 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Successfully detached device vdb from instance 6200554d-5be6-48b4-90e9-4151006d8ce3 from the live domain config.
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDWHitkv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:57:02 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0412116f-3962-441d-89e0-9fc9668baac2 req-6f91bc72-b156-4ce5-a82a-c10275cf509f service nova] Releasing lock "refresh_cache-8296720c-3b9e-4f86-8dfc-f4d7719a1a90" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquired lock "refresh_cache-8296720c-3b9e-4f86-8dfc-f4d7719a1a90" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[500cc18c-4409-4aba-b341-b4d2f0205a08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:57:02 user nova-compute[74889]: No targets found.
Nov 10 11:57:02 user nova-compute[74889]: iSNS:
Nov 10 11:57:02 user nova-compute[74889]: No targets found.
Nov 10 11:57:02 user nova-compute[74889]: STATIC:
Nov 10 11:57:02 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584
Nov 10 11:57:02 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:02 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:02 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:57:02 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:02 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:02 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207
Nov 10 11:57:02 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:02 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:02 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3
Nov 10 11:57:02 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:02 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:02 user nova-compute[74889]: FIRMWARE:
Nov 10 11:57:02 user nova-compute[74889]: No targets found.
Nov 10 11:57:02 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:57:02 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:57:02 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cc58c9-ccb9-4c75-be84-12efa6392b45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[491d964b-5ad2-45ee-acaf-70c99c03126a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:57:02 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:57:02 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:57:02 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:57:02 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:57:02 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:57:02 user nova-compute[74889]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 (non-flash)
Nov 10 11:57:02 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:57:02 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a01d1510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[de505294-e622-40ab-a0bd-6d137b608fdb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "b1a121809d94d91e81c6dc9036889af227e00e06" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.066s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c697876-a243-4d2b-a294-8a4d6c2fb65b]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[259ca12e-15ce-4878-b3c0-1d10f15ec7f6]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c021ef97-6646-483e-b18f-a3714b342fc3]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc6f9dd-104f-4057-9930-6bf77a19b112]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Successfully updated port: 37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06 --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "b1a121809d94d91e81c6dc9036889af227e00e06" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "b1a121809d94d91e81c6dc9036889af227e00e06" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc576b71-e104-41be-9f5e-fd3b8ba2de7f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquired lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207, portal: 172.16.0.220,3260]
Nov 10 11:57:02 user nova-compute[74889]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207, portal: 172.16.0.220,3260] successful.
Nov 10 11:57:02 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Updating instance_info_cache with network_info: [{"id": "1ace983c-910d-402d-ad18-a7bad9021c70", "address": "fa:16:3e:22:e8:97", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace983c-91", "ovs_interfaceid": "1ace983c-910d-402d-ad18-a7bad9021c70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-c109838a-74eb-4d58-b8af-e88dae852880 req-a90a8cda-c84b-4683-8c0f-e7537e406874 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-changed-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-c109838a-74eb-4d58-b8af-e88dae852880 req-a90a8cda-c84b-4683-8c0f-e7537e406874 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Refreshing instance network info cache due to event network-changed-37d0a738-3b02-4291-90e6-20f0a0215ab9. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c109838a-74eb-4d58-b8af-e88dae852880 req-a90a8cda-c84b-4683-8c0f-e7537e406874 service nova] Acquiring lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4babeff-1ec7-43f2-bc6c-c759827fb207 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[748edb15-26f1-476a-8bce-23db93301500]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] <== disconnect_volume: return (462ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Releasing lock "refresh_cache-8296720c-3b9e-4f86-8dfc-f4d7719a1a90" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Instance network_info: |[{"id": "1ace983c-910d-402d-ad18-a7bad9021c70", "address": "fa:16:3e:22:e8:97", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace983c-91", "ovs_interfaceid": "1ace983c-910d-402d-ad18-a7bad9021c70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Start _get_guest_xml network_info=[{"id": "1ace983c-910d-402d-ad18-a7bad9021c70", "address": "fa:16:3e:22:e8:97", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace983c-91", "ovs_interfaceid": "1ace983c-910d-402d-ad18-a7bad9021c70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:57:02 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:57:02 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1569376151',display_name='tempest-VolumesActionsTest-instance-1569376151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1569376151',id=12,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c664edf4b1844ed9592c9f5851b4bff',ramdisk_id='',reservation_id='r-ufdps3ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1744369685',owner_user_name='tempest-VolumesActionsTest-1744369685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:57:00Z,user_data=None,user_id='c0a2bf1ce37a4d05b3179b2e8573c3e1',uuid=8296720c-3b9e-4f86-8dfc-f4d7719a1a90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ace983c-910d-402d-ad18-a7bad9021c70", "address": "fa:16:3e:22:e8:97", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace983c-91", "ovs_interfaceid": "1ace983c-910d-402d-ad18-a7bad9021c70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converting VIF {"id": "1ace983c-910d-402d-ad18-a7bad9021c70", "address": "fa:16:3e:22:e8:97", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace983c-91", "ovs_interfaceid": "1ace983c-910d-402d-ad18-a7bad9021c70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=1ace983c-910d-402d-ad18-a7bad9021c70,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace983c-91') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lazy-loading 'pci_devices' on Instance uuid 8296720c-3b9e-4f86-8dfc-f4d7719a1a90 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:57:02 user nova-compute[74889]:   <uuid>8296720c-3b9e-4f86-8dfc-f4d7719a1a90</uuid>
Nov 10 11:57:02 user nova-compute[74889]:   <name>instance-0000000c</name>
Nov 10 11:57:02 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:57:02 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:57:02 user nova-compute[74889]:   <metadata>
Nov 10 11:57:02 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:57:02 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:57:02 user nova-compute[74889]:       <nova:name>tempest-VolumesActionsTest-instance-1569376151</nova:name>
Nov 10 11:57:02 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:57:02</nova:creationTime>
Nov 10 11:57:02 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:57:02 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:57:02 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:57:02 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:57:02 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:57:02 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:57:02 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:57:02 user nova-compute[74889]:       <nova:owner>
Nov 10 11:57:02 user nova-compute[74889]:         <nova:user uuid="c0a2bf1ce37a4d05b3179b2e8573c3e1">tempest-VolumesActionsTest-1744369685-project-member</nova:user>
Nov 10 11:57:02 user nova-compute[74889]:         <nova:project uuid="6c664edf4b1844ed9592c9f5851b4bff">tempest-VolumesActionsTest-1744369685</nova:project>
Nov 10 11:57:02 user nova-compute[74889]:       </nova:owner>
Nov 10 11:57:02 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:57:02 user nova-compute[74889]:       <nova:ports>
Nov 10 11:57:02 user nova-compute[74889]:         <nova:port uuid="1ace983c-910d-402d-ad18-a7bad9021c70">
Nov 10 11:57:02 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 11:57:02 user nova-compute[74889]:         </nova:port>
Nov 10 11:57:02 user nova-compute[74889]:       </nova:ports>
Nov 10 11:57:02 user nova-compute[74889]:     </nova:instance>
Nov 10 11:57:02 user nova-compute[74889]:   </metadata>
Nov 10 11:57:02 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:57:02 user nova-compute[74889]:     <system>
Nov 10 11:57:02 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:57:02 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:57:02 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:57:02 user nova-compute[74889]:       <entry name="serial">8296720c-3b9e-4f86-8dfc-f4d7719a1a90</entry>
Nov 10 11:57:02 user nova-compute[74889]:       <entry name="uuid">8296720c-3b9e-4f86-8dfc-f4d7719a1a90</entry>
Nov 10 11:57:02 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:57:02 user nova-compute[74889]:     </system>
Nov 10 11:57:02 user nova-compute[74889]:   </sysinfo>
Nov 10 11:57:02 user nova-compute[74889]:   <os>
Nov 10 11:57:02 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:57:02 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:57:02 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:57:02 user nova-compute[74889]:   </os>
Nov 10 11:57:02 user nova-compute[74889]:   <features>
Nov 10 11:57:02 user nova-compute[74889]:     <acpi/>
Nov 10 11:57:02 user nova-compute[74889]:     <apic/>
Nov 10 11:57:02 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:57:02 user nova-compute[74889]:   </features>
Nov 10 11:57:02 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:57:02 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:57:02 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:57:02 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:57:02 user nova-compute[74889]:   </clock>
Nov 10 11:57:02 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:57:02 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:57:02 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:57:02 user nova-compute[74889]:   </cpu>
Nov 10 11:57:02 user nova-compute[74889]:   <devices>
Nov 10 11:57:02 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:57:02 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:57:02 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk"/>
Nov 10 11:57:02 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:57:02 user nova-compute[74889]:     </disk>
Nov 10 11:57:02 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:57:02 user nova-compute[74889]:       <mac address="fa:16:3e:22:e8:97"/>
Nov 10 11:57:02 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:57:02 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:57:02 user nova-compute[74889]:       <target dev="tap1ace983c-91"/>
Nov 10 11:57:02 user nova-compute[74889]:     </interface>
Nov 10 11:57:02 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:57:02 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/console.log" append="off"/>
Nov 10 11:57:02 user nova-compute[74889]:     </serial>
Nov 10 11:57:02 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:57:02 user nova-compute[74889]:     <video>
Nov 10 11:57:02 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:57:02 user nova-compute[74889]:     </video>
Nov 10 11:57:02 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:57:02 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:57:02 user nova-compute[74889]:     </rng>
Nov 10 11:57:02 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:57:02 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:57:02 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:57:02 user nova-compute[74889]:     </memballoon>
Nov 10 11:57:02 user nova-compute[74889]:   </devices>
Nov 10 11:57:02 user nova-compute[74889]: </domain>
Nov 10 11:57:02 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1569376151',display_name='tempest-VolumesActionsTest-instance-1569376151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1569376151',id=12,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c664edf4b1844ed9592c9f5851b4bff',ramdisk_id='',reservation_id='r-ufdps3ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1744369685',owner_user_name='tempest-VolumesActionsTest-1744369685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:57:00Z,user_data=None,user_id='c0a2bf1ce37a4d05b3179b2e8573c3e1',uuid=8296720c-3b9e-4f86-8dfc-f4d7719a1a90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1ace983c-910d-402d-ad18-a7bad9021c70", "address": "fa:16:3e:22:e8:97", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace983c-91", "ovs_interfaceid": "1ace983c-910d-402d-ad18-a7bad9021c70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converting VIF {"id": "1ace983c-910d-402d-ad18-a7bad9021c70", "address": "fa:16:3e:22:e8:97", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace983c-91", "ovs_interfaceid": "1ace983c-910d-402d-ad18-a7bad9021c70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=1ace983c-910d-402d-ad18-a7bad9021c70,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace983c-91') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG os_vif [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=1ace983c-910d-402d-ad18-a7bad9021c70,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace983c-91') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb6b0a35-468b-5205-bc1c-3d0bae788ffe', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06 --force-share --output=json" returned: 0 in 0.261s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06,backing_fmt=raw /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06,backing_fmt=raw /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk 1073741824" returned: 0 in 0.062s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "b1a121809d94d91e81c6dc9036889af227e00e06" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.326s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1ace983c-91, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1ace983c-91, col_values=(('qos', UUID('f8e65260-0abc-4393-8e85-806f5cc8883b')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1ace983c-91, col_values=(('external_ids', {'iface-id': '1ace983c-910d-402d-ad18-a7bad9021c70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:e8:97', 'vm-uuid': '8296720c-3b9e-4f86-8dfc-f4d7719a1a90'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:57:03 user nova-compute[74889]: INFO os_vif [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=1ace983c-910d-402d-ad18-a7bad9021c70,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace983c-91')
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] No VIF found with MAC fa:16:3e:22:e8:97, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06 --force-share --output=json" returned: 0 in 0.212s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updating instance_info_cache with network_info: [{"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Releasing lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Instance network_info: |[{"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c109838a-74eb-4d58-b8af-e88dae852880 req-a90a8cda-c84b-4683-8c0f-e7537e406874 service nova] Acquired lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.network.neutron [req-c109838a-74eb-4d58-b8af-e88dae852880 req-a90a8cda-c84b-4683-8c0f-e7537e406874 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Refreshing network info cache for port 37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Cannot resize image /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Ensure instance console log exists: /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Start _get_guest_xml network_info=[{"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:56:57Z,direct_url=<?>,disk_format='qcow2',id=67949d31-8d59-4baf-9c85-11bad7396a97,min_disk=0,min_ram=0,name='tempest-scenario-img--1650746020',owner='1298008035034b9ea352dc01af38a417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:56:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '67949d31-8d59-4baf-9c85-11bad7396a97'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:57:03 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:57:03 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:56:57Z,direct_url=<?>,disk_format='qcow2',id=67949d31-8d59-4baf-9c85-11bad7396a97,min_disk=0,min_ram=0,name='tempest-scenario-img--1650746020',owner='1298008035034b9ea352dc01af38a417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:56:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1245126454',display_name='tempest-TestMinimumBasicScenario-server-1245126454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1245126454',id=13,image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7GZ41ZWNzFvBcWtC9GTpFVqgVYTBFqi084aaLambFMQNgXoeTPHI9MF8shzD+xmyYsSreQCj75/9GnV0q5V1LN3QXUdTI2poyQnKSwe5JoSZ5kbu3SuKCJK8NqZeSD3A==',key_name='tempest-TestMinimumBasicScenario-482704221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1298008035034b9ea352dc01af38a417',ramdisk_id='',reservation_id='r-0vx1c0zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1750479142',owner_user_name='tempest-TestMinimumBasicScenario-1750479142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:57:01Z,user_data=None,user_id='f59a12b24b02408e9602dd7146453a57',uuid=51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converting VIF {"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.objects.instance [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'pci_devices' on Instance uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:57:03 user nova-compute[74889]:   <uuid>51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b</uuid>
Nov 10 11:57:03 user nova-compute[74889]:   <name>instance-0000000d</name>
Nov 10 11:57:03 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:57:03 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:57:03 user nova-compute[74889]:   <metadata>
Nov 10 11:57:03 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:57:03 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:57:03 user nova-compute[74889]:       <nova:name>tempest-TestMinimumBasicScenario-server-1245126454</nova:name>
Nov 10 11:57:03 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:57:03</nova:creationTime>
Nov 10 11:57:03 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:57:03 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:57:03 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:57:03 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:57:03 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:57:03 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:57:03 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:57:03 user nova-compute[74889]:       <nova:owner>
Nov 10 11:57:03 user nova-compute[74889]:         <nova:user uuid="f59a12b24b02408e9602dd7146453a57">tempest-TestMinimumBasicScenario-1750479142-project-member</nova:user>
Nov 10 11:57:03 user nova-compute[74889]:         <nova:project uuid="1298008035034b9ea352dc01af38a417">tempest-TestMinimumBasicScenario-1750479142</nova:project>
Nov 10 11:57:03 user nova-compute[74889]:       </nova:owner>
Nov 10 11:57:03 user nova-compute[74889]:       <nova:root type="image" uuid="67949d31-8d59-4baf-9c85-11bad7396a97"/>
Nov 10 11:57:03 user nova-compute[74889]:       <nova:ports>
Nov 10 11:57:03 user nova-compute[74889]:         <nova:port uuid="37d0a738-3b02-4291-90e6-20f0a0215ab9">
Nov 10 11:57:03 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 11:57:03 user nova-compute[74889]:         </nova:port>
Nov 10 11:57:03 user nova-compute[74889]:       </nova:ports>
Nov 10 11:57:03 user nova-compute[74889]:     </nova:instance>
Nov 10 11:57:03 user nova-compute[74889]:   </metadata>
Nov 10 11:57:03 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:57:03 user nova-compute[74889]:     <system>
Nov 10 11:57:03 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:57:03 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:57:03 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:57:03 user nova-compute[74889]:       <entry name="serial">51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b</entry>
Nov 10 11:57:03 user nova-compute[74889]:       <entry name="uuid">51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b</entry>
Nov 10 11:57:03 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:57:03 user nova-compute[74889]:     </system>
Nov 10 11:57:03 user nova-compute[74889]:   </sysinfo>
Nov 10 11:57:03 user nova-compute[74889]:   <os>
Nov 10 11:57:03 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:57:03 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:57:03 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:57:03 user nova-compute[74889]:   </os>
Nov 10 11:57:03 user nova-compute[74889]:   <features>
Nov 10 11:57:03 user nova-compute[74889]:     <acpi/>
Nov 10 11:57:03 user nova-compute[74889]:     <apic/>
Nov 10 11:57:03 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:57:03 user nova-compute[74889]:   </features>
Nov 10 11:57:03 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:57:03 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:57:03 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:57:03 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:57:03 user nova-compute[74889]:   </clock>
Nov 10 11:57:03 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:57:03 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:57:03 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:57:03 user nova-compute[74889]:   </cpu>
Nov 10 11:57:03 user nova-compute[74889]:   <devices>
Nov 10 11:57:03 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:57:03 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:57:03 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk"/>
Nov 10 11:57:03 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:57:03 user nova-compute[74889]:     </disk>
Nov 10 11:57:03 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:57:03 user nova-compute[74889]:       <mac address="fa:16:3e:fe:b2:5b"/>
Nov 10 11:57:03 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:57:03 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:57:03 user nova-compute[74889]:       <target dev="tap37d0a738-3b"/>
Nov 10 11:57:03 user nova-compute[74889]:     </interface>
Nov 10 11:57:03 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:57:03 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/console.log" append="off"/>
Nov 10 11:57:03 user nova-compute[74889]:     </serial>
Nov 10 11:57:03 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:57:03 user nova-compute[74889]:     <video>
Nov 10 11:57:03 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:57:03 user nova-compute[74889]:     </video>
Nov 10 11:57:03 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:57:03 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:57:03 user nova-compute[74889]:     </rng>
Nov 10 11:57:03 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:57:03 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:57:03 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:57:03 user nova-compute[74889]:     </memballoon>
Nov 10 11:57:03 user nova-compute[74889]:   </devices>
Nov 10 11:57:03 user nova-compute[74889]: </domain>
Nov 10 11:57:03 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1245126454',display_name='tempest-TestMinimumBasicScenario-server-1245126454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1245126454',id=13,image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7GZ41ZWNzFvBcWtC9GTpFVqgVYTBFqi084aaLambFMQNgXoeTPHI9MF8shzD+xmyYsSreQCj75/9GnV0q5V1LN3QXUdTI2poyQnKSwe5JoSZ5kbu3SuKCJK8NqZeSD3A==',key_name='tempest-TestMinimumBasicScenario-482704221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1298008035034b9ea352dc01af38a417',ramdisk_id='',reservation_id='r-0vx1c0zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1750479142',owner_user_name='tempest-TestMinimumBasicScenario-1750479142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:57:01Z,user_data=None,user_id='f59a12b24b02408e9602dd7146453a57',uuid=51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converting VIF {"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG os_vif [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8eaa11fd-9034-5ebf-ab64-d095fda00eaf', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37d0a738-3b, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37d0a738-3b, col_values=(('qos', UUID('a7096040-3a8e-43ab-9b10-4bc3e0fa6dd0')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37d0a738-3b, col_values=(('external_ids', {'iface-id': '37d0a738-3b02-4291-90e6-20f0a0215ab9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:b2:5b', 'vm-uuid': '51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:03 user nova-compute[74889]: INFO os_vif [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b')
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] No VIF found with MAC fa:16:3e:fe:b2:5b, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.network.neutron [req-c109838a-74eb-4d58-b8af-e88dae852880 req-a90a8cda-c84b-4683-8c0f-e7537e406874 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updated VIF entry in instance network info cache for port 37d0a738-3b02-4291-90e6-20f0a0215ab9. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG nova.network.neutron [req-c109838a-74eb-4d58-b8af-e88dae852880 req-a90a8cda-c84b-4683-8c0f-e7537e406874 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updating instance_info_cache with network_info: [{"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c109838a-74eb-4d58-b8af-e88dae852880 req-a90a8cda-c84b-4683-8c0f-e7537e406874 service nova] Releasing lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:57:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lazy-loading 'flavor' on Instance uuid 81cfb431-3aee-4081-82ba-49612a294d61 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:04 user nova-compute[74889]: INFO nova.compute.manager [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Attaching volume d957df2b-d960-4680-be76-66c60934730c to /dev/vdc
Nov 10 11:57:04 user nova-compute[74889]: DEBUG os_brick.utils [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[04869a6e-7b62-4070-9a27-1f01ee828e88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e4c05b-be37-476f-be21-db1d90406855]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9948d1-e67e-4463-bcb8-3dbc3a1621d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff0682b-5292-4afb-8c4f-d121d84eb91b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:57:04 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:57:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[948af85e-2f44-4f7f-a0c4-b07fbe4ec562]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG os_brick.utils [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:57:04 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Updating existing volume attachment record: 11c7c790-7b44-4530-a49b-c1017957b999 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:57:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-cae47b82-5e02-4abc-a735-6596acba5da6 req-70ae9327-65fa-4d1c-a6f9-e14bfc40e14c service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Received event network-vif-plugged-1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cae47b82-5e02-4abc-a735-6596acba5da6 req-70ae9327-65fa-4d1c-a6f9-e14bfc40e14c service nova] Acquiring lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cae47b82-5e02-4abc-a735-6596acba5da6 req-70ae9327-65fa-4d1c-a6f9-e14bfc40e14c service nova] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cae47b82-5e02-4abc-a735-6596acba5da6 req-70ae9327-65fa-4d1c-a6f9-e14bfc40e14c service nova] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-cae47b82-5e02-4abc-a735-6596acba5da6 req-70ae9327-65fa-4d1c-a6f9-e14bfc40e14c service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] No waiting events found dispatching network-vif-plugged-1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:57:05 user nova-compute[74889]: WARNING nova.compute.manager [req-cae47b82-5e02-4abc-a735-6596acba5da6 req-70ae9327-65fa-4d1c-a6f9-e14bfc40e14c service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Received unexpected event network-vif-plugged-1ace983c-910d-402d-ad18-a7bad9021c70 for instance with vm_state building and task_state spawning.
Nov 10 11:57:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-f62669ba-3666-4724-a795-6b70398a5df4 req-c0538906-caf5-488b-9279-7190f09d2ea0 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f62669ba-3666-4724-a795-6b70398a5df4 req-c0538906-caf5-488b-9279-7190f09d2ea0 service nova] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f62669ba-3666-4724-a795-6b70398a5df4 req-c0538906-caf5-488b-9279-7190f09d2ea0 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f62669ba-3666-4724-a795-6b70398a5df4 req-c0538906-caf5-488b-9279-7190f09d2ea0 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-f62669ba-3666-4724-a795-6b70398a5df4 req-c0538906-caf5-488b-9279-7190f09d2ea0 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] No waiting events found dispatching network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:57:06 user nova-compute[74889]: WARNING nova.compute.manager [req-f62669ba-3666-4724-a795-6b70398a5df4 req-c0538906-caf5-488b-9279-7190f09d2ea0 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received unexpected event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 for instance with vm_state building and task_state spawning.
Nov 10 11:57:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-77897c7c-c051-4acd-b6b2-a986980e1b64 req-a225e4e9-5072-4fb1-a52c-c7ccd59834db service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Received event network-vif-plugged-1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-77897c7c-c051-4acd-b6b2-a986980e1b64 req-a225e4e9-5072-4fb1-a52c-c7ccd59834db service nova] Acquiring lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-77897c7c-c051-4acd-b6b2-a986980e1b64 req-a225e4e9-5072-4fb1-a52c-c7ccd59834db service nova] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-77897c7c-c051-4acd-b6b2-a986980e1b64 req-a225e4e9-5072-4fb1-a52c-c7ccd59834db service nova] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-77897c7c-c051-4acd-b6b2-a986980e1b64 req-a225e4e9-5072-4fb1-a52c-c7ccd59834db service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] No waiting events found dispatching network-vif-plugged-1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:57:07 user nova-compute[74889]: WARNING nova.compute.manager [req-77897c7c-c051-4acd-b6b2-a986980e1b64 req-a225e4e9-5072-4fb1-a52c-c7ccd59834db service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Received unexpected event network-vif-plugged-1ace983c-910d-402d-ad18-a7bad9021c70 for instance with vm_state building and task_state spawning.
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-f9deed5a-2973-4890-aef1-8743489d1278 req-fd42b4d1-28fe-40ea-b44f-25736677d8b4 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f9deed5a-2973-4890-aef1-8743489d1278 req-fd42b4d1-28fe-40ea-b44f-25736677d8b4 service nova] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f9deed5a-2973-4890-aef1-8743489d1278 req-fd42b4d1-28fe-40ea-b44f-25736677d8b4 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f9deed5a-2973-4890-aef1-8743489d1278 req-fd42b4d1-28fe-40ea-b44f-25736677d8b4 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-f9deed5a-2973-4890-aef1-8743489d1278 req-fd42b4d1-28fe-40ea-b44f-25736677d8b4 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] No waiting events found dispatching network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:57:08 user nova-compute[74889]: WARNING nova.compute.manager [req-f9deed5a-2973-4890-aef1-8743489d1278 req-fd42b4d1-28fe-40ea-b44f-25736677d8b4 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received unexpected event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 for instance with vm_state building and task_state spawning.
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:08 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Instance spawned successfully.
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:57:08 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Instance spawned successfully.
Nov 10 11:57:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:57:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:09 user nova-compute[74889]: INFO nova.compute.manager [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Took 9.31 seconds to spawn the instance on the hypervisor.
Nov 10 11:57:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:57:09 user nova-compute[74889]: INFO nova.compute.manager [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Took 7.81 seconds to spawn the instance on the hypervisor.
Nov 10 11:57:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:57:09 user nova-compute[74889]: INFO nova.compute.manager [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Took 10.13 seconds to build instance.
Nov 10 11:57:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ccc2650b-f123-464e-aa89-f5c1981bfa76 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.271s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:09 user nova-compute[74889]: INFO nova.compute.manager [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Took 8.85 seconds to build instance.
Nov 10 11:57:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0f737040-5958-4dab-ad75-b88c6c26682b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.969s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:57:15 user nova-compute[74889]: WARNING nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 10 11:57:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 19d4137a-5cdf-42d1-8846-35813d6360f6 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 6200554d-5be6-48b4-90e9-4151006d8ce3 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid ff790962-c708-465c-a240-36748871cfda {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 81cfb431-3aee-4081-82ba-49612a294d61 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 61077e59-6249-4a6e-b749-733ed9735bb2 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 8296720c-3b9e-4f86-8dfc-f4d7719a1a90 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "19d4137a-5cdf-42d1-8846-35813d6360f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "ff790962-c708-465c-a240-36748871cfda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "ff790962-c708-465c-a240-36748871cfda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:15 user nova-compute[74889]: INFO nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: ff790962-c708-465c-a240-36748871cfda] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "ff790962-c708-465c-a240-36748871cfda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.174s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.179s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG nova.objects.instance [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lazy-loading 'flavor' on Instance uuid 6200554d-5be6-48b4-90e9-4151006d8ce3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c540acdd-cc0d-4058-bf29-898d6b8ba5ea tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 42.825s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.799s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.volume.cinder [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Update attachment failed for attachment 11c7c790-7b44-4530-a49b-c1017957b999. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a6164239-c255-4a94-b5ce-7423292bb762) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a6164239-c255-4a94-b5ce-7423292bb762)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Failed to attach d957df2b-d960-4680-be76-66c60934730c at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a6164239-c255-4a94-b5ce-7423292bb762)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Traceback (most recent call last):
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     self._do_attach(context, instance, volume, volume_api,
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     self._volume_attach(context, volume, connector, instance,
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     connection_info = volume_api.attachment_update(
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     res = method(self, ctx, *args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     with excutils.save_and_reraise_exception():
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     self.force_reraise()
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     raise self.value
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     return method.func(obj, *args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     resp = self._update('/attachments/%s' % id, body)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     return self.request(url, method, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61]     raise exceptions.from_response(resp, body)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a6164239-c255-4a94-b5ce-7423292bb762)
Nov 10 11:57:24 user nova-compute[74889]: ERROR nova.compute.manager [instance: 81cfb431-3aee-4081-82ba-49612a294d61] 
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:57:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Creating image(s)
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "/opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "/opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:24 user nova-compute[74889]: INFO nova.compute.manager [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Detaching volume 54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.336s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "81cfb431-3aee-4081-82ba-49612a294d61" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.260s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "81cfb431-3aee-4081-82ba-49612a294d61" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server [None req-3bd84e3a-2914-4463-947d-ad35a78f04d5 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a6164239-c255-4a94-b5ce-7423292bb762)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a6164239-c255-4a94-b5ce-7423292bb762)
Nov 10 11:57:24 user nova-compute[74889]: ERROR oslo_messaging.rpc.server 
Nov 10 11:57:24 user nova-compute[74889]: INFO nova.virt.block_device [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Attempting to driver detach volume 54c47476-ac7b-496c-87b5-70b24843f2de from mountpoint /dev/vdb
Nov 10 11:57:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Attempting to detach device vdb from instance 527ef5ba-c67a-481a-b835-e8b6196f3902 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:57:24 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:57:24 user nova-compute[74889]:   <source dev="/dev/sdc"/>
Nov 10 11:57:24 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:57:24 user nova-compute[74889]:   <serial>54c47476-ac7b-496c-87b5-70b24843f2de</serial>
Nov 10 11:57:24 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 11:57:24 user nova-compute[74889]: </disk>
Nov 10 11:57:24 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:57:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully detached device vdb from instance 527ef5ba-c67a-481a-b835-e8b6196f3902 from the persistent domain config.
Nov 10 11:57:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 527ef5ba-c67a-481a-b835-e8b6196f3902 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:57:24 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:57:24 user nova-compute[74889]:   <source dev="/dev/sdc"/>
Nov 10 11:57:24 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:57:24 user nova-compute[74889]:   <serial>54c47476-ac7b-496c-87b5-70b24843f2de</serial>
Nov 10 11:57:24 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 11:57:24 user nova-compute[74889]: </disk>
Nov 10 11:57:24 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk 1073741824" returned: 0 in 0.047s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Cannot resize image /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Ensure instance console log exists: /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Start _get_guest_xml network_info=[{"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJLxoOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ff790962-c708-465c-a240-36748871cfda', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2f008cc-bb29-47ea-acbb-e97402d482b9', 'serial': 'b2f008cc-bb29-47ea-acbb-e97402d482b9'}, 'disk_bus': 'virtio', 'attachment_id': '9057a8ed-3bf8-4fce-acf6-dc0c4bf84fc0', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:57:25 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 11:57:25 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.objects.instance [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'vcpu_model' on Instance uuid ff790962-c708-465c-a240-36748871cfda {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJLxoOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:57:25 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:57:25 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:57:25 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f591e22-0fcb-4b93-b488-47a092cadd3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:57:25 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7a4cdf-fbfd-40a2-bdc3-ae403fefe7dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9] added
Nov 10 11:57:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cf0e25-4f07-4d18-bd97-9e04b0fd2f55]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cbb361-dc51-48b1-a94f-ee8e930e7cb3]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJLxoOMG {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJLxoOMG" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae13edc7-6a8b-46ac-ad11-0ca78fd58bd4]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJLxoOMG'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b884740d-aacf-4806-9630-7c7cefc79157]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54ca20d-5cc8-45d0-b481-c9b0feaecf8b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:57:25 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:57:25 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:57:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:57:25 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:57:25 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:57:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff73cbe-5279-44e3-aab9-eacb95d3f3ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260]
Nov 10 11:57:25 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260] successful.
Nov 10 11:57:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc7d9c0-f57a-4ecd-b1e6-0d8ffc15c51e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b834b-6eae-456c-98d3-6d75278a8d8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:57:26 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:57:26 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:57:26 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:57:26 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:57:26 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:57:26 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:57:26 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:57:26 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78e4fba-bf36-4353-9bd9-a5f8e98d48c5]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:26 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJLxoOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23630393238353436', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630393238353436', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T11:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-642189030',display_name='tempest-ServerActionsTestOtherA-server-273336335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-642189030',id=9,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0/XF+AB0GhusuxdUy4KCbA5BHH0mEXd6UsrJkBP5cRseQe4LcHZRtV1gX4Erce1ZdBd4lGhhKkzpZ8/b9Vm+ldnYnA6+7h9G9k9ev9qm8TXn29kna1Abvhrmq647o0WA==',key_name='tempest-keypair-958761505',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-fqz1x6s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=ff790962-c708-465c-a240-36748871cfda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:57:27 user nova-compute[74889]:   <uuid>ff790962-c708-465c-a240-36748871cfda</uuid>
Nov 10 11:57:27 user nova-compute[74889]:   <name>instance-00000009</name>
Nov 10 11:57:27 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:57:27 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:57:27 user nova-compute[74889]:   <metadata>
Nov 10 11:57:27 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:57:27 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:57:27 user nova-compute[74889]:       <nova:name>tempest-ServerActionsTestOtherA-server-273336335</nova:name>
Nov 10 11:57:27 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:57:25</nova:creationTime>
Nov 10 11:57:27 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:57:27 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:57:27 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:57:27 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:57:27 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:57:27 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:57:27 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:57:27 user nova-compute[74889]:       <nova:owner>
Nov 10 11:57:27 user nova-compute[74889]:         <nova:user uuid="8f4638ca003c46dab10aab2e5a2e6fb4">tempest-ServerActionsTestOtherA-631643283-project-member</nova:user>
Nov 10 11:57:27 user nova-compute[74889]:         <nova:project uuid="688cad5e5288440bb533d6e2c2f764c1">tempest-ServerActionsTestOtherA-631643283</nova:project>
Nov 10 11:57:27 user nova-compute[74889]:       </nova:owner>
Nov 10 11:57:27 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:57:27 user nova-compute[74889]:       <nova:ports>
Nov 10 11:57:27 user nova-compute[74889]:         <nova:port uuid="9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53">
Nov 10 11:57:27 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 11:57:27 user nova-compute[74889]:         </nova:port>
Nov 10 11:57:27 user nova-compute[74889]:       </nova:ports>
Nov 10 11:57:27 user nova-compute[74889]:     </nova:instance>
Nov 10 11:57:27 user nova-compute[74889]:   </metadata>
Nov 10 11:57:27 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:57:27 user nova-compute[74889]:     <system>
Nov 10 11:57:27 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:57:27 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:57:27 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:57:27 user nova-compute[74889]:       <entry name="serial">ff790962-c708-465c-a240-36748871cfda</entry>
Nov 10 11:57:27 user nova-compute[74889]:       <entry name="uuid">ff790962-c708-465c-a240-36748871cfda</entry>
Nov 10 11:57:27 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:57:27 user nova-compute[74889]:     </system>
Nov 10 11:57:27 user nova-compute[74889]:   </sysinfo>
Nov 10 11:57:27 user nova-compute[74889]:   <os>
Nov 10 11:57:27 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:57:27 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:57:27 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:57:27 user nova-compute[74889]:   </os>
Nov 10 11:57:27 user nova-compute[74889]:   <features>
Nov 10 11:57:27 user nova-compute[74889]:     <acpi/>
Nov 10 11:57:27 user nova-compute[74889]:     <apic/>
Nov 10 11:57:27 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:57:27 user nova-compute[74889]:   </features>
Nov 10 11:57:27 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:57:27 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:57:27 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:57:27 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:57:27 user nova-compute[74889]:   </clock>
Nov 10 11:57:27 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:57:27 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:57:27 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:57:27 user nova-compute[74889]:   </cpu>
Nov 10 11:57:27 user nova-compute[74889]:   <devices>
Nov 10 11:57:27 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:57:27 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:57:27 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk"/>
Nov 10 11:57:27 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:57:27 user nova-compute[74889]:     </disk>
Nov 10 11:57:27 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 11:57:27 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:57:27 user nova-compute[74889]:       <source dev="/dev/sdd"/>
Nov 10 11:57:27 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 11:57:27 user nova-compute[74889]:       <serial>b2f008cc-bb29-47ea-acbb-e97402d482b9</serial>
Nov 10 11:57:27 user nova-compute[74889]:     </disk>
Nov 10 11:57:27 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:57:27 user nova-compute[74889]:       <mac address="fa:16:3e:28:d7:7a"/>
Nov 10 11:57:27 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:57:27 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:57:27 user nova-compute[74889]:       <target dev="tap9cf86e63-f9"/>
Nov 10 11:57:27 user nova-compute[74889]:     </interface>
Nov 10 11:57:27 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:57:27 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/console.log" append="off"/>
Nov 10 11:57:27 user nova-compute[74889]:     </serial>
Nov 10 11:57:27 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:57:27 user nova-compute[74889]:     <video>
Nov 10 11:57:27 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:57:27 user nova-compute[74889]:     </video>
Nov 10 11:57:27 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:57:27 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:57:27 user nova-compute[74889]:     </rng>
Nov 10 11:57:27 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:57:27 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:57:27 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:57:27 user nova-compute[74889]:     </memballoon>
Nov 10 11:57:27 user nova-compute[74889]:   </devices>
Nov 10 11:57:27 user nova-compute[74889]: </domain>
Nov 10 11:57:27 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T11:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-642189030',display_name='tempest-ServerActionsTestOtherA-server-273336335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-642189030',id=9,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0/XF+AB0GhusuxdUy4KCbA5BHH0mEXd6UsrJkBP5cRseQe4LcHZRtV1gX4Erce1ZdBd4lGhhKkzpZ8/b9Vm+ldnYnA6+7h9G9k9ev9qm8TXn29kna1Abvhrmq647o0WA==',key_name='tempest-keypair-958761505',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:54:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-fqz1x6s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=ff790962-c708-465c-a240-36748871cfda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG os_vif [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f293219-6465-58bd-92b9-9370c1e68826', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cf86e63-f9, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cf86e63-f9, col_values=(('qos', UUID('ad6c9fbc-e73d-48e0-839e-4f17bb42efa5')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cf86e63-f9, col_values=(('external_ids', {'iface-id': '9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:d7:7a', 'vm-uuid': 'ff790962-c708-465c-a240-36748871cfda'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:27 user nova-compute[74889]: INFO os_vif [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9')
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:57:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No VIF found with MAC fa:16:3e:28:d7:7a, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-1a5eb9d5-1592-4b48-b71e-a3802c609a42 req-2368b5af-7bb8-4414-bf58-d037d3f30d99 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1a5eb9d5-1592-4b48-b71e-a3802c609a42 req-2368b5af-7bb8-4414-bf58-d037d3f30d99 service nova] Acquiring lock "ff790962-c708-465c-a240-36748871cfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1a5eb9d5-1592-4b48-b71e-a3802c609a42 req-2368b5af-7bb8-4414-bf58-d037d3f30d99 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1a5eb9d5-1592-4b48-b71e-a3802c609a42 req-2368b5af-7bb8-4414-bf58-d037d3f30d99 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-1a5eb9d5-1592-4b48-b71e-a3802c609a42 req-2368b5af-7bb8-4414-bf58-d037d3f30d99 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] No waiting events found dispatching network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:57:28 user nova-compute[74889]: WARNING nova.compute.manager [req-1a5eb9d5-1592-4b48-b71e-a3802c609a42 req-2368b5af-7bb8-4414-bf58-d037d3f30d99 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received unexpected event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 11:57:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-c1c1858c-1814-4110-9a67-8c5b6d06754c req-fceb45a6-7176-49d1-a54b-a7255d2e7c8a service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1c1858c-1814-4110-9a67-8c5b6d06754c req-fceb45a6-7176-49d1-a54b-a7255d2e7c8a service nova] Acquiring lock "ff790962-c708-465c-a240-36748871cfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1c1858c-1814-4110-9a67-8c5b6d06754c req-fceb45a6-7176-49d1-a54b-a7255d2e7c8a service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1c1858c-1814-4110-9a67-8c5b6d06754c req-fceb45a6-7176-49d1-a54b-a7255d2e7c8a service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-c1c1858c-1814-4110-9a67-8c5b6d06754c req-fceb45a6-7176-49d1-a54b-a7255d2e7c8a service nova] [instance: ff790962-c708-465c-a240-36748871cfda] No waiting events found dispatching network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:57:30 user nova-compute[74889]: WARNING nova.compute.manager [req-c1c1858c-1814-4110-9a67-8c5b6d06754c req-fceb45a6-7176-49d1-a54b-a7255d2e7c8a service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received unexpected event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 11:57:30 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: ff790962-c708-465c-a240-36748871cfda] Instance spawned successfully.
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:57:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG nova.objects.instance [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74889) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-816fcf2b-9ad8-4942-a0d1-aefc191f0261 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:31 user nova-compute[74889]: INFO nova.compute.manager [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Terminating instance
Nov 10 11:57:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-22207183-f19c-4892-96c1-ccd62b77700f req-742bd1c5-deae-4409-b305-51a55196eaff service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-vif-unplugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-22207183-f19c-4892-96c1-ccd62b77700f req-742bd1c5-deae-4409-b305-51a55196eaff service nova] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-22207183-f19c-4892-96c1-ccd62b77700f req-742bd1c5-deae-4409-b305-51a55196eaff service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-22207183-f19c-4892-96c1-ccd62b77700f req-742bd1c5-deae-4409-b305-51a55196eaff service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-22207183-f19c-4892-96c1-ccd62b77700f req-742bd1c5-deae-4409-b305-51a55196eaff service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] No waiting events found dispatching network-vif-unplugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:57:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-22207183-f19c-4892-96c1-ccd62b77700f req-742bd1c5-deae-4409-b305-51a55196eaff service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-vif-unplugged-da93881f-7f2f-401e-8dcd-a881954e3905 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Instance destroyed successfully.
Nov 10 11:57:32 user nova-compute[74889]: DEBUG nova.objects.instance [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lazy-loading 'resources' on Instance uuid 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T11:52:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1990135163',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-868336549',id=7,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0uHLQXQj7dInSfVC9TaIgqa+9RQkjH42pg0qSxOcSGwGx0kYhgRvc39hCLN0H5L4IYuYHZeUvD0cEK5tcx4IArwdZ7cEmkvJUn/s+QbltOH4DHvllrCcGkdiSwTNa9tg==',key_name='tempest-keypair-27701663',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:55:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c0db768727f4544865ec53756cf5e4f',ramdisk_id='',reservation_id='r-3vgvinwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1329161327',owner_user_name='tempest-ServerActionsV293TestJSON-1329161327-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:55:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82bd448d0c3045aeb1114169f1a952b9',uuid=54fa74ec-d37c-4517-8f83-9ea1f23c1cc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converting VIF {"id": "da93881f-7f2f-401e-8dcd-a881954e3905", "address": "fa:16:3e:95:7d:80", "network": {"id": "03390126-4af5-48a9-b0ba-7886ad8c96aa", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1875170735-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c0db768727f4544865ec53756cf5e4f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda93881f-7f", "ovs_interfaceid": "da93881f-7f2f-401e-8dcd-a881954e3905", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_vif [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda93881f-7f, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b4f43eb-ec23-4ec6-af51-1222a801ac43) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:32 user nova-compute[74889]: INFO os_vif [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:7d:80,bridge_name='br-int',has_traffic_filtering=True,id=da93881f-7f2f-401e-8dcd-a881954e3905,network=Network(03390126-4af5-48a9-b0ba-7886ad8c96aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda93881f-7f')
Nov 10 11:57:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qrQcnwRI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:57:32 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4751bc4a-fbbe-4898-ba1d-9f693c9945e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:57:32 user nova-compute[74889]: No targets found.
Nov 10 11:57:32 user nova-compute[74889]: iSNS:
Nov 10 11:57:32 user nova-compute[74889]: No targets found.
Nov 10 11:57:32 user nova-compute[74889]: STATIC:
Nov 10 11:57:32 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9
Nov 10 11:57:32 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:32 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:32 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584
Nov 10 11:57:32 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:32 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:32 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:57:32 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:32 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:32 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3
Nov 10 11:57:32 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:32 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:32 user nova-compute[74889]: FIRMWARE:
Nov 10 11:57:32 user nova-compute[74889]: No targets found.
Nov 10 11:57:32 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:57:32 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:57:32 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[725f7148-7a6f-4367-a887-2e564fc4bcb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec68a2cd-0d21-455f-9f1e-6339f840eb9d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:57:32 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:57:32 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:57:32 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:57:32 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:57:32 user nova-compute[74889]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 (non-flash)
Nov 10 11:57:32 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:57:32 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:57:32 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a33cc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b36f596-b63e-4d65-94d8-21f1172601e3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[240be9ce-7cce-4cba-a548-38bb34369b9e]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[42eaf141-101e-4283-8923-decb444e9766]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7ef393-0a8d-47a8-9a6b-ce46b4835f98]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26666613766363831', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_74dbf3ba', '/dev/disk/by-id/scsi-1SCST_BIO74dbf3ba-ffa7f68193bc96d1') {{(pid=85601) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f43d711-c86d-42a7-b689-50045aa1def7]: (4, None) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7998154d-14ab-4105-b6e9-9543310eaf1b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[050ad5af-70f2-44ab-b5e6-fe5563edd509]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260]
Nov 10 11:57:32 user nova-compute[74889]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3, portal: 172.16.0.220,3260] successful.
Nov 10 11:57:32 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83e12811-d82a-4e65-a0b1-b4c84ecad9e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb2dd3e-74a8-47eb-8fe7-21b19dce053c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] <== disconnect_volume: return (400ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:57:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Deleting instance files /opt/stack/data/nova/instances/54fa74ec-d37c-4517-8f83-9ea1f23c1cc4_del
Nov 10 11:57:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Deletion of /opt/stack/data/nova/instances/54fa74ec-d37c-4517-8f83-9ea1f23c1cc4_del complete
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:32 user nova-compute[74889]: INFO nova.compute.manager [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:57:33 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Took 0.87 seconds to deallocate network for instance.
Nov 10 11:57:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:33 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Error from libvirt while getting description of instance-00000007: [Error Code 42] Domain not found: no domain with matching uuid '54fa74ec-d37c-4517-8f83-9ea1f23c1cc4' (instance-00000007): libvirt.libvirtError: Domain not found: no domain with matching uuid '54fa74ec-d37c-4517-8f83-9ea1f23c1cc4' (instance-00000007)
Nov 10 11:57:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-5ee9c035-bda0-42bc-ae3f-46904989352c req-0ce2b2e4-e666-4cee-af0a-92eb2df23b3e service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5ee9c035-bda0-42bc-ae3f-46904989352c req-0ce2b2e4-e666-4cee-af0a-92eb2df23b3e service nova] Acquiring lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5ee9c035-bda0-42bc-ae3f-46904989352c req-0ce2b2e4-e666-4cee-af0a-92eb2df23b3e service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5ee9c035-bda0-42bc-ae3f-46904989352c req-0ce2b2e4-e666-4cee-af0a-92eb2df23b3e service nova] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-5ee9c035-bda0-42bc-ae3f-46904989352c req-0ce2b2e4-e666-4cee-af0a-92eb2df23b3e service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] No waiting events found dispatching network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:57:33 user nova-compute[74889]: WARNING nova.compute.manager [req-5ee9c035-bda0-42bc-ae3f-46904989352c req-0ce2b2e4-e666-4cee-af0a-92eb2df23b3e service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received unexpected event network-vif-plugged-da93881f-7f2f-401e-8dcd-a881954e3905 for instance with vm_state active and task_state deleting.
Nov 10 11:57:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-5ee9c035-bda0-42bc-ae3f-46904989352c req-0ce2b2e4-e666-4cee-af0a-92eb2df23b3e service nova] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Received event network-vif-deleted-da93881f-7f2f-401e-8dcd-a881954e3905 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.340s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:34 user nova-compute[74889]: INFO nova.compute.manager [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Took 1.11 seconds to detach 1 volumes for instance.
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG nova.compute.manager [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] [instance: 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4] Deleting volume: 83e12811-d82a-4e65-a0b1-b4c84ecad9e3 {{(pid=74889) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Refreshing inventories for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Updating ProviderTree inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Refreshing aggregate associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, aggregates: None {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Refreshing trait associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.959s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:35 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Deleted allocations for instance 54fa74ec-d37c-4517-8f83-9ea1f23c1cc4
Nov 10 11:57:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8a898699-3c28-4744-b9fb-93e0d2573da6 tempest-ServerActionsV293TestJSON-1329161327 tempest-ServerActionsV293TestJSON-1329161327-project-member] Lock "54fa74ec-d37c-4517-8f83-9ea1f23c1cc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.740s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:37 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:57:37 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7731MB free_disk=25.565563201904297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6200554d-5be6-48b4-90e9-4151006d8ce3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance ff790962-c708-465c-a240-36748871cfda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 81cfb431-3aee-4081-82ba-49612a294d61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 61077e59-6249-4a6e-b749-733ed9735bb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 8296720c-3b9e-4f86-8dfc-f4d7719a1a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:57:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:38 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:57:38 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:57:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:40 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:57:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:57:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:57:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:57:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 11:57:41 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updating instance_info_cache with network_info: [{"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:57:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:57:41 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 11:57:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:57:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:57:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:57:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:57:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:57:42 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:57:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:45 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 527ef5ba-c67a-481a-b835-e8b6196f3902 is timed out.
Nov 10 11:57:45 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully detached device vdb from instance 527ef5ba-c67a-481a-b835-e8b6196f3902 from the live domain config.
Nov 10 11:57:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJRCNbgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:57:45 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4584c322-64a9-405d-8e52-1ee5e39509c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:57:45 user nova-compute[74889]: No targets found.
Nov 10 11:57:45 user nova-compute[74889]: iSNS:
Nov 10 11:57:45 user nova-compute[74889]: No targets found.
Nov 10 11:57:45 user nova-compute[74889]: STATIC:
Nov 10 11:57:45 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9
Nov 10 11:57:45 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:45 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:45 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584
Nov 10 11:57:45 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:45 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:45 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de
Nov 10 11:57:45 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:57:45 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:57:45 user nova-compute[74889]: FIRMWARE:
Nov 10 11:57:45 user nova-compute[74889]: No targets found.
Nov 10 11:57:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:57:45 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:57:45 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b171df6-aea9-4673-8330-9b39c276999c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff4fefa-9bb7-4192-9fe6-5d771f723dc3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:57:45 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:57:45 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:57:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de (non-flash)
Nov 10 11:57:45 user nova-compute[74889]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:57:45 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:57:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398394940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de'): ({'sdc'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Removing single pathed devices sdc {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30fe937-0811-49c2-aa40-970edf85479b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e49ed4-e182-451a-9100-21955fb16458]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flushing IO for device /dev/sdc {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eaff1b-3f8c-4f30-be3c-bfdc1fa87a85]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.067s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1581a3-f116-4c17-83bf-afc46f250b6d]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9933382a-7810-4eae-8f0f-44a52f8707f1]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c9592c-f53b-4a12-a74f-a341e5e2731d]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260]
Nov 10 11:57:45 user nova-compute[74889]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de, portal: 172.16.0.220,3260] successful.
Nov 10 11:57:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54c47476-ac7b-496c-87b5-70b24843f2de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3961d85-6c8d-4a48-95e8-b191fc229ad8]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== disconnect_volume: return (372ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:57:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:57:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:57:46 user nova-compute[74889]: INFO nova.compute.manager [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] instance snapshotting
Nov 10 11:57:47 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b746116-4400-4f5a-ab93-13d667526965 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.276s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:47 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Beginning live snapshot process
Nov 10 11:57:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json -f qcow2 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json -f qcow2 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json -f qcow2" returned: 0 in 0.241s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-34174cc2-8136-433b-8101-48915433e1ec tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-34174cc2-8136-433b-8101-48915433e1ec tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-34174cc2-8136-433b-8101-48915433e1ec tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-34174cc2-8136-433b-8101-48915433e1ec tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74889) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG nova.objects.instance [None req-34174cc2-8136-433b-8101-48915433e1ec tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfg9rj6q0/2beadfcc284a4aa884a8ebbbe16c50aa.delta 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfg9rj6q0/2beadfcc284a4aa884a8ebbbe16c50aa.delta 1073741824" returned: 0 in 0.049s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:47 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 11:57:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-c712aa2a-e000-4daf-838c-ef08f845573b req-cc9a61af-96c7-49a6-806f-f7aa85b0c150 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-unplugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c712aa2a-e000-4daf-838c-ef08f845573b req-cc9a61af-96c7-49a6-806f-f7aa85b0c150 service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c712aa2a-e000-4daf-838c-ef08f845573b req-cc9a61af-96c7-49a6-806f-f7aa85b0c150 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c712aa2a-e000-4daf-838c-ef08f845573b req-cc9a61af-96c7-49a6-806f-f7aa85b0c150 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-c712aa2a-e000-4daf-838c-ef08f845573b req-cc9a61af-96c7-49a6-806f-f7aa85b0c150 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-unplugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:57:48 user nova-compute[74889]: WARNING nova.compute.manager [req-c712aa2a-e000-4daf-838c-ef08f845573b req-cc9a61af-96c7-49a6-806f-f7aa85b0c150 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-unplugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state active and task_state powering-off.
Nov 10 11:57:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:57:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance destroyed successfully.
Nov 10 11:57:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-34174cc2-8136-433b-8101-48915433e1ec tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:57:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-34174cc2-8136-433b-8101-48915433e1ec tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.335s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 11:57:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 11:57:49 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 11:57:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfg9rj6q0/2beadfcc284a4aa884a8ebbbe16c50aa.delta /opt/stack/data/nova/instances/snapshots/tmpfg9rj6q0/2beadfcc284a4aa884a8ebbbe16c50aa {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfg9rj6q0/2beadfcc284a4aa884a8ebbbe16c50aa.delta /opt/stack/data/nova/instances/snapshots/tmpfg9rj6q0/2beadfcc284a4aa884a8ebbbe16c50aa" returned: 0 in 0.444s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Snapshot extracted, beginning image upload
Nov 10 11:57:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-6a1a6e36-333c-4931-afba-a1165c612714 req-3035f1f4-1eb5-49f4-aaf1-5a86e7a7a390 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6a1a6e36-333c-4931-afba-a1165c612714 req-3035f1f4-1eb5-49f4-aaf1-5a86e7a7a390 service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6a1a6e36-333c-4931-afba-a1165c612714 req-3035f1f4-1eb5-49f4-aaf1-5a86e7a7a390 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6a1a6e36-333c-4931-afba-a1165c612714 req-3035f1f4-1eb5-49f4-aaf1-5a86e7a7a390 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-6a1a6e36-333c-4931-afba-a1165c612714 req-3035f1f4-1eb5-49f4-aaf1-5a86e7a7a390 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:57:50 user nova-compute[74889]: WARNING nova.compute.manager [req-6a1a6e36-333c-4931-afba-a1165c612714 req-3035f1f4-1eb5-49f4-aaf1-5a86e7a7a390 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state stopped and task_state None.
Nov 10 11:57:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:52 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Snapshot image upload complete
Nov 10 11:57:52 user nova-compute[74889]: INFO nova.compute.manager [None req-551c4ffd-ef68-45ec-9fb3-3259d96c2f84 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Took 5.99 seconds to snapshot the instance on the hypervisor.
Nov 10 11:57:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "fc53bac7-d79d-4c33-af61-340b00dd8758" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:57:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:57:55 user nova-compute[74889]: INFO nova.compute.claims [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Claim successful on node user
Nov 10 11:57:56 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:57:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:57:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:57:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Creating image(s)
Nov 10 11:57:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "/opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "/opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "427d78cb05e9acb28003b4a22b63c2469e42fdf7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "427d78cb05e9acb28003b4a22b63c2469e42fdf7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:56 user nova-compute[74889]: DEBUG nova.policy [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0713f019fd484ce58496c9038295dad3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde601a6b8e24d988c49013a8fe6f0fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:57:57 user nova-compute[74889]: DEBUG nova.compute.manager [req-9e3f9ede-5a3c-4bcc-8b86-4d6cd48b07b5 req-7482f801-a5ab-4e95-9b13-bd69f962e06b service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received event network-changed-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:57 user nova-compute[74889]: DEBUG nova.compute.manager [req-9e3f9ede-5a3c-4bcc-8b86-4d6cd48b07b5 req-7482f801-a5ab-4e95-9b13-bd69f962e06b service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Refreshing instance network info cache due to event network-changed-ea862be1-a0e1-4e74-9464-9cfb4201f611. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:57:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e3f9ede-5a3c-4bcc-8b86-4d6cd48b07b5 req-7482f801-a5ab-4e95-9b13-bd69f962e06b service nova] Acquiring lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:57:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e3f9ede-5a3c-4bcc-8b86-4d6cd48b07b5 req-7482f801-a5ab-4e95-9b13-bd69f962e06b service nova] Acquired lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:57:57 user nova-compute[74889]: DEBUG nova.network.neutron [req-9e3f9ede-5a3c-4bcc-8b86-4d6cd48b07b5 req-7482f801-a5ab-4e95-9b13-bd69f962e06b service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Refreshing network info cache for port ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:57:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7.part --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:58 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Successfully created port: 64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:57:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7.part --force-share --output=json" returned: 0 in 0.218s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:58 user nova-compute[74889]: DEBUG nova.virt.images [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] ea9a6918-741c-4f96-ab81-aef1ad6789c3 was qcow2, converting to raw {{(pid=74889) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 11:57:58 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 11:57:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7.part /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7.converted {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:58 user nova-compute[74889]: DEBUG nova.network.neutron [req-9e3f9ede-5a3c-4bcc-8b86-4d6cd48b07b5 req-7482f801-a5ab-4e95-9b13-bd69f962e06b service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Updated VIF entry in instance network info cache for port ea862be1-a0e1-4e74-9464-9cfb4201f611. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:57:58 user nova-compute[74889]: DEBUG nova.network.neutron [req-9e3f9ede-5a3c-4bcc-8b86-4d6cd48b07b5 req-7482f801-a5ab-4e95-9b13-bd69f962e06b service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Updating instance_info_cache with network_info: [{"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:57:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e3f9ede-5a3c-4bcc-8b86-4d6cd48b07b5 req-7482f801-a5ab-4e95-9b13-bd69f962e06b service nova] Releasing lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7.part /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7.converted" returned: 0 in 0.510s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7.converted --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "427d78cb05e9acb28003b4a22b63c2469e42fdf7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.525s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Successfully updated port: 64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquired lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-48372c95-b408-40f0-af92-cf9307076985 req-ede39fe9-2fa5-4b3b-8c95-f01e55e700bd service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received event network-changed-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-48372c95-b408-40f0-af92-cf9307076985 req-ede39fe9-2fa5-4b3b-8c95-f01e55e700bd service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Refreshing instance network info cache due to event network-changed-64d5dc91-1a08-49c0-919e-d12b925316be. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-48372c95-b408-40f0-af92-cf9307076985 req-ede39fe9-2fa5-4b3b-8c95-f01e55e700bd service nova] Acquiring lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7 --force-share --output=json" returned: 0 in 0.284s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "427d78cb05e9acb28003b4a22b63c2469e42fdf7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "427d78cb05e9acb28003b4a22b63c2469e42fdf7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7 --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7,backing_fmt=raw /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7,backing_fmt=raw /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk 1073741824" returned: 0 in 0.054s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "427d78cb05e9acb28003b4a22b63c2469e42fdf7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Updating instance_info_cache with network_info: [{"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Releasing lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Instance network_info: |[{"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:57:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-48372c95-b408-40f0-af92-cf9307076985 req-ede39fe9-2fa5-4b3b-8c95-f01e55e700bd service nova] Acquired lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.network.neutron [req-48372c95-b408-40f0-af92-cf9307076985 req-ede39fe9-2fa5-4b3b-8c95-f01e55e700bd service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Refreshing network info cache for port 64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7 --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Ensure instance console log exists: /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.008s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Start _get_guest_xml network_info=[{"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='665381d22ca288583c215c61d4b6db1c',container_format='bare',created_at=2023-11-10T11:57:47Z,direct_url=<?>,disk_format='qcow2',id=ea9a6918-741c-4f96-ab81-aef1ad6789c3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1002690929',owner='cde601a6b8e24d988c49013a8fe6f0fb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T11:57:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'ea9a6918-741c-4f96-ab81-aef1ad6789c3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:58:00 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:58:00 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='665381d22ca288583c215c61d4b6db1c',container_format='bare',created_at=2023-11-10T11:57:47Z,direct_url=<?>,disk_format='qcow2',id=ea9a6918-741c-4f96-ab81-aef1ad6789c3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1002690929',owner='cde601a6b8e24d988c49013a8fe6f0fb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T11:57:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-168257770',display_name='tempest-TestStampPattern-server-168257770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-168257770',id=14,image_ref='ea9a6918-741c-4f96-ab81-aef1ad6789c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxDwFs0AGsEtr15Zi6x2wsIDGQYgbiQSBAGO7YjoF8bCXJVpt9lKEMaMnjKkVdYpvjgsEv3fRCgW9Gc/EdEP0DEjX5Wcf4b9A5MJqJw73kiAjUo/ElWA2D+2WH2oMrVxQ==',key_name='tempest-TestStampPattern-81644911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde601a6b8e24d988c49013a8fe6f0fb',ramdisk_id='',reservation_id='r-cm370ddd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6200554d-5be6-48b4-90e9-4151006d8ce3',image_min_disk='1',image_min_ram='0',image_owner_id='cde601a6b8e24d988c49013a8fe6f0fb',image_owner_project_name='tempest-TestStampPattern-1182113080',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1182113080-project-member',image_user_id='0713f019fd484ce58496c9038295dad3',network_allocated='True',owner_project_name='tempest-TestStampPattern-1182113080',owner_user_name='tempest-TestStampPattern-1182113080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:57:57Z,user_data=None,user_id='0713f019fd484ce58496c9038295dad3',uuid=fc53bac7-d79d-4c33-af61-340b00dd8758,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converting VIF {"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:58:ad,bridge_name='br-int',has_traffic_filtering=True,id=64d5dc91-1a08-49c0-919e-d12b925316be,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d5dc91-1a') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lazy-loading 'pci_devices' on Instance uuid fc53bac7-d79d-4c33-af61-340b00dd8758 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:58:00 user nova-compute[74889]:   <uuid>fc53bac7-d79d-4c33-af61-340b00dd8758</uuid>
Nov 10 11:58:00 user nova-compute[74889]:   <name>instance-0000000e</name>
Nov 10 11:58:00 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:58:00 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:58:00 user nova-compute[74889]:   <metadata>
Nov 10 11:58:00 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:58:00 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:58:00 user nova-compute[74889]:       <nova:name>tempest-TestStampPattern-server-168257770</nova:name>
Nov 10 11:58:00 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:58:00</nova:creationTime>
Nov 10 11:58:00 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:58:00 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:58:00 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:58:00 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:58:00 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:58:00 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:58:00 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:58:00 user nova-compute[74889]:       <nova:owner>
Nov 10 11:58:00 user nova-compute[74889]:         <nova:user uuid="0713f019fd484ce58496c9038295dad3">tempest-TestStampPattern-1182113080-project-member</nova:user>
Nov 10 11:58:00 user nova-compute[74889]:         <nova:project uuid="cde601a6b8e24d988c49013a8fe6f0fb">tempest-TestStampPattern-1182113080</nova:project>
Nov 10 11:58:00 user nova-compute[74889]:       </nova:owner>
Nov 10 11:58:00 user nova-compute[74889]:       <nova:root type="image" uuid="ea9a6918-741c-4f96-ab81-aef1ad6789c3"/>
Nov 10 11:58:00 user nova-compute[74889]:       <nova:ports>
Nov 10 11:58:00 user nova-compute[74889]:         <nova:port uuid="64d5dc91-1a08-49c0-919e-d12b925316be">
Nov 10 11:58:00 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 11:58:00 user nova-compute[74889]:         </nova:port>
Nov 10 11:58:00 user nova-compute[74889]:       </nova:ports>
Nov 10 11:58:00 user nova-compute[74889]:     </nova:instance>
Nov 10 11:58:00 user nova-compute[74889]:   </metadata>
Nov 10 11:58:00 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:58:00 user nova-compute[74889]:     <system>
Nov 10 11:58:00 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:58:00 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:58:00 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:58:00 user nova-compute[74889]:       <entry name="serial">fc53bac7-d79d-4c33-af61-340b00dd8758</entry>
Nov 10 11:58:00 user nova-compute[74889]:       <entry name="uuid">fc53bac7-d79d-4c33-af61-340b00dd8758</entry>
Nov 10 11:58:00 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:58:00 user nova-compute[74889]:     </system>
Nov 10 11:58:00 user nova-compute[74889]:   </sysinfo>
Nov 10 11:58:00 user nova-compute[74889]:   <os>
Nov 10 11:58:00 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:58:00 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:58:00 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:58:00 user nova-compute[74889]:   </os>
Nov 10 11:58:00 user nova-compute[74889]:   <features>
Nov 10 11:58:00 user nova-compute[74889]:     <acpi/>
Nov 10 11:58:00 user nova-compute[74889]:     <apic/>
Nov 10 11:58:00 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:58:00 user nova-compute[74889]:   </features>
Nov 10 11:58:00 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:58:00 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:58:00 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:58:00 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:58:00 user nova-compute[74889]:   </clock>
Nov 10 11:58:00 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:58:00 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:58:00 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:58:00 user nova-compute[74889]:   </cpu>
Nov 10 11:58:00 user nova-compute[74889]:   <devices>
Nov 10 11:58:00 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:58:00 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:58:00 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk"/>
Nov 10 11:58:00 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:58:00 user nova-compute[74889]:     </disk>
Nov 10 11:58:00 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:58:00 user nova-compute[74889]:       <mac address="fa:16:3e:b5:58:ad"/>
Nov 10 11:58:00 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:58:00 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:58:00 user nova-compute[74889]:       <target dev="tap64d5dc91-1a"/>
Nov 10 11:58:00 user nova-compute[74889]:     </interface>
Nov 10 11:58:00 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:58:00 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/console.log" append="off"/>
Nov 10 11:58:00 user nova-compute[74889]:     </serial>
Nov 10 11:58:00 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:58:00 user nova-compute[74889]:     <video>
Nov 10 11:58:00 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:58:00 user nova-compute[74889]:     </video>
Nov 10 11:58:00 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:58:00 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:58:00 user nova-compute[74889]:     </rng>
Nov 10 11:58:00 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:58:00 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:58:00 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:58:00 user nova-compute[74889]:     </memballoon>
Nov 10 11:58:00 user nova-compute[74889]:   </devices>
Nov 10 11:58:00 user nova-compute[74889]: </domain>
Nov 10 11:58:00 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-168257770',display_name='tempest-TestStampPattern-server-168257770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-168257770',id=14,image_ref='ea9a6918-741c-4f96-ab81-aef1ad6789c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxDwFs0AGsEtr15Zi6x2wsIDGQYgbiQSBAGO7YjoF8bCXJVpt9lKEMaMnjKkVdYpvjgsEv3fRCgW9Gc/EdEP0DEjX5Wcf4b9A5MJqJw73kiAjUo/ElWA2D+2WH2oMrVxQ==',key_name='tempest-TestStampPattern-81644911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cde601a6b8e24d988c49013a8fe6f0fb',ramdisk_id='',reservation_id='r-cm370ddd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6200554d-5be6-48b4-90e9-4151006d8ce3',image_min_disk='1',image_min_ram='0',image_owner_id='cde601a6b8e24d988c49013a8fe6f0fb',image_owner_project_name='tempest-TestStampPattern-1182113080',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1182113080-project-member',image_user_id='0713f019fd484ce58496c9038295dad3',network_allocated='True',owner_project_name='tempest-TestStampPattern-1182113080',owner_user_name='tempest-TestStampPattern-1182113080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:57:57Z,user_data=None,user_id='0713f019fd484ce58496c9038295dad3',uuid=fc53bac7-d79d-4c33-af61-340b00dd8758,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converting VIF {"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:58:ad,bridge_name='br-int',has_traffic_filtering=True,id=64d5dc91-1a08-49c0-919e-d12b925316be,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d5dc91-1a') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG os_vif [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:58:ad,bridge_name='br-int',has_traffic_filtering=True,id=64d5dc91-1a08-49c0-919e-d12b925316be,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d5dc91-1a') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'effbd885-76b5-59d4-baa6-0a157dc571ab', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64d5dc91-1a, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64d5dc91-1a, col_values=(('qos', UUID('f70a1e01-9712-456a-940f-6a989f1332ad')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64d5dc91-1a, col_values=(('external_ids', {'iface-id': '64d5dc91-1a08-49c0-919e-d12b925316be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:58:ad', 'vm-uuid': 'fc53bac7-d79d-4c33-af61-340b00dd8758'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:00 user nova-compute[74889]: INFO os_vif [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:58:ad,bridge_name='br-int',has_traffic_filtering=True,id=64d5dc91-1a08-49c0-919e-d12b925316be,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d5dc91-1a')
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] No VIF found with MAC fa:16:3e:b5:58:ad, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.network.neutron [req-48372c95-b408-40f0-af92-cf9307076985 req-ede39fe9-2fa5-4b3b-8c95-f01e55e700bd service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Updated VIF entry in instance network info cache for port 64d5dc91-1a08-49c0-919e-d12b925316be. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG nova.network.neutron [req-48372c95-b408-40f0-af92-cf9307076985 req-ede39fe9-2fa5-4b3b-8c95-f01e55e700bd service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Updating instance_info_cache with network_info: [{"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-48372c95-b408-40f0-af92-cf9307076985 req-ede39fe9-2fa5-4b3b-8c95-f01e55e700bd service nova] Releasing lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:58:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-6df42f69-64d8-4f93-8d6d-bf6bb6532f09 req-61fda9b3-ee74-4f39-82e1-fb0eeef644dd service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received event network-vif-plugged-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6df42f69-64d8-4f93-8d6d-bf6bb6532f09 req-61fda9b3-ee74-4f39-82e1-fb0eeef644dd service nova] Acquiring lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6df42f69-64d8-4f93-8d6d-bf6bb6532f09 req-61fda9b3-ee74-4f39-82e1-fb0eeef644dd service nova] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6df42f69-64d8-4f93-8d6d-bf6bb6532f09 req-61fda9b3-ee74-4f39-82e1-fb0eeef644dd service nova] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-6df42f69-64d8-4f93-8d6d-bf6bb6532f09 req-61fda9b3-ee74-4f39-82e1-fb0eeef644dd service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] No waiting events found dispatching network-vif-plugged-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:58:02 user nova-compute[74889]: WARNING nova.compute.manager [req-6df42f69-64d8-4f93-8d6d-bf6bb6532f09 req-61fda9b3-ee74-4f39-82e1-fb0eeef644dd service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received unexpected event network-vif-plugged-64d5dc91-1a08-49c0-919e-d12b925316be for instance with vm_state building and task_state spawning.
Nov 10 11:58:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-a7bac357-4ea5-4447-a067-384f4eaec3fe req-4dfbfe13-fa19-410f-98e5-151c00c8cb90 service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received event network-vif-plugged-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a7bac357-4ea5-4447-a067-384f4eaec3fe req-4dfbfe13-fa19-410f-98e5-151c00c8cb90 service nova] Acquiring lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a7bac357-4ea5-4447-a067-384f4eaec3fe req-4dfbfe13-fa19-410f-98e5-151c00c8cb90 service nova] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a7bac357-4ea5-4447-a067-384f4eaec3fe req-4dfbfe13-fa19-410f-98e5-151c00c8cb90 service nova] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-a7bac357-4ea5-4447-a067-384f4eaec3fe req-4dfbfe13-fa19-410f-98e5-151c00c8cb90 service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] No waiting events found dispatching network-vif-plugged-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:58:04 user nova-compute[74889]: WARNING nova.compute.manager [req-a7bac357-4ea5-4447-a067-384f4eaec3fe req-4dfbfe13-fa19-410f-98e5-151c00c8cb90 service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received unexpected event network-vif-plugged-64d5dc91-1a08-49c0-919e-d12b925316be for instance with vm_state building and task_state spawning.
Nov 10 11:58:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lazy-loading 'flavor' on Instance uuid 61077e59-6249-4a6e-b749-733ed9735bb2 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:58:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:58:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Instance spawned successfully.
Nov 10 11:58:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:05 user nova-compute[74889]: INFO nova.compute.manager [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Attaching volume be5da929-5f07-4239-98d3-1506254f1037 to /dev/vdb
Nov 10 11:58:05 user nova-compute[74889]: INFO nova.compute.manager [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Took 8.46 seconds to spawn the instance on the hypervisor.
Nov 10 11:58:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG os_brick.utils [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe865c49-38fb-46d5-9a93-1d192b59a344]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[690b9c4a-6ea1-4b49-a026-c864e1c35820]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4baea0-1139-434c-84ea-6693d109c0e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fea7c0-f8bc-4d48-82dc-31c85dbceb28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:05 user nova-compute[74889]: INFO nova.compute.manager [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Took 9.72 seconds to build instance.
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:58:05 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceca2b06-52a9-451b-b094-82a0ec3dd0b8]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG os_brick.utils [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Updating existing volume attachment record: babbd107-7944-4a1e-8afc-71a0bcd5ac52 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e1ed9fc9-e360-4eb8-a177-4b0855aae4ae tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.894s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:58:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:58:19 user nova-compute[74889]: INFO nova.compute.claims [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Claim successful on node user
Nov 10 11:58:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG nova.network.neutron [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:58:20 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:58:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG nova.policy [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9f9a0d401cc4f53b97396ec66e5ac69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bfc5c65f3ec4fedb9b968e20399aeab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:58:20 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Creating image(s)
Nov 10 11:58:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk 1073741824" returned: 0 in 0.049s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.206s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG nova.network.neutron [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Successfully created port: 9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Cannot resize image /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Ensure instance console log exists: /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG nova.network.neutron [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Successfully updated port: 9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquired lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG nova.network.neutron [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-3ed8fe02-c6e8-42e3-a76b-f1cefb681f2f req-df8e3885-b321-4c93-a6f8-4f8e4891f95a service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-changed-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-3ed8fe02-c6e8-42e3-a76b-f1cefb681f2f req-df8e3885-b321-4c93-a6f8-4f8e4891f95a service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Refreshing instance network info cache due to event network-changed-9616e5e2-f3ec-455f-b303-9dd4bede6596. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3ed8fe02-c6e8-42e3-a76b-f1cefb681f2f req-df8e3885-b321-4c93-a6f8-4f8e4891f95a service nova] Acquiring lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG nova.network.neutron [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG nova.network.neutron [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updating instance_info_cache with network_info: [{"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Releasing lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG nova.compute.manager [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Instance network_info: |[{"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3ed8fe02-c6e8-42e3-a76b-f1cefb681f2f req-df8e3885-b321-4c93-a6f8-4f8e4891f95a service nova] Acquired lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG nova.network.neutron [req-3ed8fe02-c6e8-42e3-a76b-f1cefb681f2f req-df8e3885-b321-4c93-a6f8-4f8e4891f95a service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Refreshing network info cache for port 9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:58:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Start _get_guest_xml network_info=[{"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:58:23 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:58:23 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021355343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021355343',id=15,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0vequKP+K5HhXnSZEekp/UTgizqm44CF7EwBTHzQ3YrW5/0KlwgVsmqJxdfyDOzcFvmhjOI1nY67HVgkbNSp+Wusi+soHfSh0U5hG8mvTVgzxbmEuelIU3LcM+ZQt2JQ==',key_name='tempest-keypair-1815934162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfc5c65f3ec4fedb9b968e20399aeab',ramdisk_id='',reservation_id='r-sc38cubd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-866426842',owner_user_name='tempest-TaggedAttachmentsTest-866426842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f9a0d401cc4f53b97396ec66e5ac69',uuid=d6a0ffdd-1c72-4a34-b652-d14a01965ad5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converting VIF {"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:c5:6e,bridge_name='br-int',has_traffic_filtering=True,id=9616e5e2-f3ec-455f-b303-9dd4bede6596,network=Network(96cc5a6c-a454-447b-938a-e64c120b8b0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616e5e2-f3') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.objects.instance [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lazy-loading 'pci_devices' on Instance uuid d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:58:23 user nova-compute[74889]:   <uuid>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</uuid>
Nov 10 11:58:23 user nova-compute[74889]:   <name>instance-0000000f</name>
Nov 10 11:58:23 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:58:23 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:58:23 user nova-compute[74889]:   <metadata>
Nov 10 11:58:23 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:58:23 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:58:23 user nova-compute[74889]:       <nova:name>tempest-device-tagging-server-2021355343</nova:name>
Nov 10 11:58:23 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:58:23</nova:creationTime>
Nov 10 11:58:23 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:58:23 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:58:23 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:58:23 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:58:23 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:58:23 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:58:23 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:58:23 user nova-compute[74889]:       <nova:owner>
Nov 10 11:58:23 user nova-compute[74889]:         <nova:user uuid="d9f9a0d401cc4f53b97396ec66e5ac69">tempest-TaggedAttachmentsTest-866426842-project-member</nova:user>
Nov 10 11:58:23 user nova-compute[74889]:         <nova:project uuid="9bfc5c65f3ec4fedb9b968e20399aeab">tempest-TaggedAttachmentsTest-866426842</nova:project>
Nov 10 11:58:23 user nova-compute[74889]:       </nova:owner>
Nov 10 11:58:23 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:58:23 user nova-compute[74889]:       <nova:ports>
Nov 10 11:58:23 user nova-compute[74889]:         <nova:port uuid="9616e5e2-f3ec-455f-b303-9dd4bede6596">
Nov 10 11:58:23 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 11:58:23 user nova-compute[74889]:         </nova:port>
Nov 10 11:58:23 user nova-compute[74889]:       </nova:ports>
Nov 10 11:58:23 user nova-compute[74889]:     </nova:instance>
Nov 10 11:58:23 user nova-compute[74889]:   </metadata>
Nov 10 11:58:23 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:58:23 user nova-compute[74889]:     <system>
Nov 10 11:58:23 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:58:23 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:58:23 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:58:23 user nova-compute[74889]:       <entry name="serial">d6a0ffdd-1c72-4a34-b652-d14a01965ad5</entry>
Nov 10 11:58:23 user nova-compute[74889]:       <entry name="uuid">d6a0ffdd-1c72-4a34-b652-d14a01965ad5</entry>
Nov 10 11:58:23 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:58:23 user nova-compute[74889]:     </system>
Nov 10 11:58:23 user nova-compute[74889]:   </sysinfo>
Nov 10 11:58:23 user nova-compute[74889]:   <os>
Nov 10 11:58:23 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:58:23 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:58:23 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:58:23 user nova-compute[74889]:   </os>
Nov 10 11:58:23 user nova-compute[74889]:   <features>
Nov 10 11:58:23 user nova-compute[74889]:     <acpi/>
Nov 10 11:58:23 user nova-compute[74889]:     <apic/>
Nov 10 11:58:23 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:58:23 user nova-compute[74889]:   </features>
Nov 10 11:58:23 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:58:23 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:58:23 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:58:23 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:58:23 user nova-compute[74889]:   </clock>
Nov 10 11:58:23 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:58:23 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:58:23 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:58:23 user nova-compute[74889]:   </cpu>
Nov 10 11:58:23 user nova-compute[74889]:   <devices>
Nov 10 11:58:23 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:58:23 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:58:23 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk"/>
Nov 10 11:58:23 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:58:23 user nova-compute[74889]:     </disk>
Nov 10 11:58:23 user nova-compute[74889]:     <disk type="file" device="cdrom">
Nov 10 11:58:23 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 11:58:23 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.config"/>
Nov 10 11:58:23 user nova-compute[74889]:       <target dev="hda" bus="ide"/>
Nov 10 11:58:23 user nova-compute[74889]:     </disk>
Nov 10 11:58:23 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:58:23 user nova-compute[74889]:       <mac address="fa:16:3e:34:c5:6e"/>
Nov 10 11:58:23 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:58:23 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:58:23 user nova-compute[74889]:       <target dev="tap9616e5e2-f3"/>
Nov 10 11:58:23 user nova-compute[74889]:     </interface>
Nov 10 11:58:23 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:58:23 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/console.log" append="off"/>
Nov 10 11:58:23 user nova-compute[74889]:     </serial>
Nov 10 11:58:23 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:58:23 user nova-compute[74889]:     <video>
Nov 10 11:58:23 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:58:23 user nova-compute[74889]:     </video>
Nov 10 11:58:23 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:58:23 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:58:23 user nova-compute[74889]:     </rng>
Nov 10 11:58:23 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:58:23 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:58:23 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:58:23 user nova-compute[74889]:     </memballoon>
Nov 10 11:58:23 user nova-compute[74889]:   </devices>
Nov 10 11:58:23 user nova-compute[74889]: </domain>
Nov 10 11:58:23 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021355343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021355343',id=15,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0vequKP+K5HhXnSZEekp/UTgizqm44CF7EwBTHzQ3YrW5/0KlwgVsmqJxdfyDOzcFvmhjOI1nY67HVgkbNSp+Wusi+soHfSh0U5hG8mvTVgzxbmEuelIU3LcM+ZQt2JQ==',key_name='tempest-keypair-1815934162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9bfc5c65f3ec4fedb9b968e20399aeab',ramdisk_id='',reservation_id='r-sc38cubd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-866426842',owner_user_name='tempest-TaggedAttachmentsTest-866426842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f9a0d401cc4f53b97396ec66e5ac69',uuid=d6a0ffdd-1c72-4a34-b652-d14a01965ad5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converting VIF {"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:c5:6e,bridge_name='br-int',has_traffic_filtering=True,id=9616e5e2-f3ec-455f-b303-9dd4bede6596,network=Network(96cc5a6c-a454-447b-938a-e64c120b8b0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616e5e2-f3') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG os_vif [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:c5:6e,bridge_name='br-int',has_traffic_filtering=True,id=9616e5e2-f3ec-455f-b303-9dd4bede6596,network=Network(96cc5a6c-a454-447b-938a-e64c120b8b0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616e5e2-f3') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e958025c-cdbf-580b-a859-8b767da528aa', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9616e5e2-f3, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9616e5e2-f3, col_values=(('qos', UUID('81e0f73e-fd5c-4c0a-b1dd-576ad53545ef')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9616e5e2-f3, col_values=(('external_ids', {'iface-id': '9616e5e2-f3ec-455f-b303-9dd4bede6596', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:c5:6e', 'vm-uuid': 'd6a0ffdd-1c72-4a34-b652-d14a01965ad5'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:23 user nova-compute[74889]: INFO os_vif [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:c5:6e,bridge_name='br-int',has_traffic_filtering=True,id=9616e5e2-f3ec-455f-b303-9dd4bede6596,network=Network(96cc5a6c-a454-447b-938a-e64c120b8b0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616e5e2-f3')
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] No BDM found with device name hda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] No VIF found with MAC fa:16:3e:34:c5:6e, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:58:23 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Using config drive
Nov 10 11:58:23 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Creating config drive at /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.config
Nov 10 11:58:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzkpo1xcy {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzkpo1xcy" returned: 0 in 0.064s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.network.neutron [req-3ed8fe02-c6e8-42e3-a76b-f1cefb681f2f req-df8e3885-b321-4c93-a6f8-4f8e4891f95a service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updated VIF entry in instance network info cache for port 9616e5e2-f3ec-455f-b303-9dd4bede6596. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG nova.network.neutron [req-3ed8fe02-c6e8-42e3-a76b-f1cefb681f2f req-df8e3885-b321-4c93-a6f8-4f8e4891f95a service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updating instance_info_cache with network_info: [{"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3ed8fe02-c6e8-42e3-a76b-f1cefb681f2f req-df8e3885-b321-4c93-a6f8-4f8e4891f95a service nova] Releasing lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:58:24 user nova-compute[74889]: INFO nova.compute.claims [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Claim successful on node user
Nov 10 11:58:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.network.neutron [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:58:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.policy [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3485bf67f27e4b72868b0adc1225bfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6ad4f23d94494b3f42cdbc7fd4516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:58:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Creating image(s)
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "/opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "/opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "/opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-c9ab9304-f0a1-433b-9b3c-57f9a359c56d req-67288fc0-b7cf-42ed-8e38-965fcdc2dfac service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-plugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9ab9304-f0a1-433b-9b3c-57f9a359c56d req-67288fc0-b7cf-42ed-8e38-965fcdc2dfac service nova] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9ab9304-f0a1-433b-9b3c-57f9a359c56d req-67288fc0-b7cf-42ed-8e38-965fcdc2dfac service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9ab9304-f0a1-433b-9b3c-57f9a359c56d req-67288fc0-b7cf-42ed-8e38-965fcdc2dfac service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-c9ab9304-f0a1-433b-9b3c-57f9a359c56d req-67288fc0-b7cf-42ed-8e38-965fcdc2dfac service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] No waiting events found dispatching network-vif-plugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:58:25 user nova-compute[74889]: WARNING nova.compute.manager [req-c9ab9304-f0a1-433b-9b3c-57f9a359c56d req-67288fc0-b7cf-42ed-8e38-965fcdc2dfac service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received unexpected event network-vif-plugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 for instance with vm_state building and task_state spawning.
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.228s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk 1073741824" returned: 0 in 0.058s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Cannot resize image /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Ensure instance console log exists: /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG nova.network.neutron [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Successfully created port: 01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:58:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.compute.manager [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:58:27 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Instance spawned successfully.
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Successfully updated port: 01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquired lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-4fb1b796-4383-4aeb-9c82-b136359058d9 req-7d203277-e40f-49d9-b26f-dc68dcd9906a service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received event network-changed-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-4fb1b796-4383-4aeb-9c82-b136359058d9 req-7d203277-e40f-49d9-b26f-dc68dcd9906a service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Refreshing instance network info cache due to event network-changed-01fa2c48-958b-485c-b34e-b7ceb445bca4. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4fb1b796-4383-4aeb-9c82-b136359058d9 req-7d203277-e40f-49d9-b26f-dc68dcd9906a service nova] Acquiring lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:58:27 user nova-compute[74889]: INFO nova.compute.manager [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Took 6.63 seconds to spawn the instance on the hypervisor.
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.compute.manager [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:58:27 user nova-compute[74889]: INFO nova.compute.manager [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Took 7.57 seconds to build instance.
Nov 10 11:58:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-626ac975-880d-477f-8975-ab03e0de4d39 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.734s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-fa448ce9-9d33-4854-8988-747b3ee2f4dd req-343bd135-333b-4867-bcc9-67686646b94c service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-plugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fa448ce9-9d33-4854-8988-747b3ee2f4dd req-343bd135-333b-4867-bcc9-67686646b94c service nova] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fa448ce9-9d33-4854-8988-747b3ee2f4dd req-343bd135-333b-4867-bcc9-67686646b94c service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fa448ce9-9d33-4854-8988-747b3ee2f4dd req-343bd135-333b-4867-bcc9-67686646b94c service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-fa448ce9-9d33-4854-8988-747b3ee2f4dd req-343bd135-333b-4867-bcc9-67686646b94c service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] No waiting events found dispatching network-vif-plugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:58:27 user nova-compute[74889]: WARNING nova.compute.manager [req-fa448ce9-9d33-4854-8988-747b3ee2f4dd req-343bd135-333b-4867-bcc9-67686646b94c service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received unexpected event network-vif-plugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 for instance with vm_state active and task_state None.
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Updating instance_info_cache with network_info: [{"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Releasing lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.compute.manager [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Instance network_info: |[{"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4fb1b796-4383-4aeb-9c82-b136359058d9 req-7d203277-e40f-49d9-b26f-dc68dcd9906a service nova] Acquired lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.network.neutron [req-4fb1b796-4383-4aeb-9c82-b136359058d9 req-7d203277-e40f-49d9-b26f-dc68dcd9906a service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Refreshing network info cache for port 01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Start _get_guest_xml network_info=[{"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:58:27 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:58:27 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-480762283',display_name='tempest-AttachVolumeNegativeTest-server-480762283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-480762283',id=16,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8d+/OpfsXA0MKlqL3YjZVtnaCmv9LS7/Q+r9D7QjLWvuFISJHe9VCnEnDjJEWJS0Pjf/zUQ3fFt0csaJxTtOojcoE0dofeG523Cjqb5T75ZHi/svH2e67ixAXmmCa8cg==',key_name='tempest-keypair-956495493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-z8j7e8ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=93367290-6fa4-4bbe-b47b-2dfa27227bed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:fa:dc,bridge_name='br-int',has_traffic_filtering=True,id=01fa2c48-958b-485c-b34e-b7ceb445bca4,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fa2c48-95') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.objects.instance [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'pci_devices' on Instance uuid 93367290-6fa4-4bbe-b47b-2dfa27227bed {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:58:27 user nova-compute[74889]:   <uuid>93367290-6fa4-4bbe-b47b-2dfa27227bed</uuid>
Nov 10 11:58:27 user nova-compute[74889]:   <name>instance-00000010</name>
Nov 10 11:58:27 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:58:27 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:58:27 user nova-compute[74889]:   <metadata>
Nov 10 11:58:27 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:58:27 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:58:27 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeNegativeTest-server-480762283</nova:name>
Nov 10 11:58:27 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:58:27</nova:creationTime>
Nov 10 11:58:27 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:58:27 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:58:27 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:58:27 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:58:27 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:58:27 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:58:27 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:58:27 user nova-compute[74889]:       <nova:owner>
Nov 10 11:58:27 user nova-compute[74889]:         <nova:user uuid="3485bf67f27e4b72868b0adc1225bfeb">tempest-AttachVolumeNegativeTest-238498304-project-member</nova:user>
Nov 10 11:58:27 user nova-compute[74889]:         <nova:project uuid="80c6ad4f23d94494b3f42cdbc7fd4516">tempest-AttachVolumeNegativeTest-238498304</nova:project>
Nov 10 11:58:27 user nova-compute[74889]:       </nova:owner>
Nov 10 11:58:27 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:58:27 user nova-compute[74889]:       <nova:ports>
Nov 10 11:58:27 user nova-compute[74889]:         <nova:port uuid="01fa2c48-958b-485c-b34e-b7ceb445bca4">
Nov 10 11:58:27 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 11:58:27 user nova-compute[74889]:         </nova:port>
Nov 10 11:58:27 user nova-compute[74889]:       </nova:ports>
Nov 10 11:58:27 user nova-compute[74889]:     </nova:instance>
Nov 10 11:58:27 user nova-compute[74889]:   </metadata>
Nov 10 11:58:27 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:58:27 user nova-compute[74889]:     <system>
Nov 10 11:58:27 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:58:27 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:58:27 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:58:27 user nova-compute[74889]:       <entry name="serial">93367290-6fa4-4bbe-b47b-2dfa27227bed</entry>
Nov 10 11:58:27 user nova-compute[74889]:       <entry name="uuid">93367290-6fa4-4bbe-b47b-2dfa27227bed</entry>
Nov 10 11:58:27 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:58:27 user nova-compute[74889]:     </system>
Nov 10 11:58:27 user nova-compute[74889]:   </sysinfo>
Nov 10 11:58:27 user nova-compute[74889]:   <os>
Nov 10 11:58:27 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:58:27 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:58:27 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:58:27 user nova-compute[74889]:   </os>
Nov 10 11:58:27 user nova-compute[74889]:   <features>
Nov 10 11:58:27 user nova-compute[74889]:     <acpi/>
Nov 10 11:58:27 user nova-compute[74889]:     <apic/>
Nov 10 11:58:27 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:58:27 user nova-compute[74889]:   </features>
Nov 10 11:58:27 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:58:27 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:58:27 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:58:27 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:58:27 user nova-compute[74889]:   </clock>
Nov 10 11:58:27 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:58:27 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:58:27 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:58:27 user nova-compute[74889]:   </cpu>
Nov 10 11:58:27 user nova-compute[74889]:   <devices>
Nov 10 11:58:27 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:58:27 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:58:27 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk"/>
Nov 10 11:58:27 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:58:27 user nova-compute[74889]:     </disk>
Nov 10 11:58:27 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:58:27 user nova-compute[74889]:       <mac address="fa:16:3e:fc:fa:dc"/>
Nov 10 11:58:27 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:58:27 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:58:27 user nova-compute[74889]:       <target dev="tap01fa2c48-95"/>
Nov 10 11:58:27 user nova-compute[74889]:     </interface>
Nov 10 11:58:27 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:58:27 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/console.log" append="off"/>
Nov 10 11:58:27 user nova-compute[74889]:     </serial>
Nov 10 11:58:27 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:58:27 user nova-compute[74889]:     <video>
Nov 10 11:58:27 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:58:27 user nova-compute[74889]:     </video>
Nov 10 11:58:27 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:58:27 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:58:27 user nova-compute[74889]:     </rng>
Nov 10 11:58:27 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:58:27 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:58:27 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:58:27 user nova-compute[74889]:     </memballoon>
Nov 10 11:58:27 user nova-compute[74889]:   </devices>
Nov 10 11:58:27 user nova-compute[74889]: </domain>
Nov 10 11:58:27 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-480762283',display_name='tempest-AttachVolumeNegativeTest-server-480762283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-480762283',id=16,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8d+/OpfsXA0MKlqL3YjZVtnaCmv9LS7/Q+r9D7QjLWvuFISJHe9VCnEnDjJEWJS0Pjf/zUQ3fFt0csaJxTtOojcoE0dofeG523Cjqb5T75ZHi/svH2e67ixAXmmCa8cg==',key_name='tempest-keypair-956495493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-z8j7e8ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=93367290-6fa4-4bbe-b47b-2dfa27227bed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:fa:dc,bridge_name='br-int',has_traffic_filtering=True,id=01fa2c48-958b-485c-b34e-b7ceb445bca4,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fa2c48-95') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG os_vif [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:fa:dc,bridge_name='br-int',has_traffic_filtering=True,id=01fa2c48-958b-485c-b34e-b7ceb445bca4,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fa2c48-95') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acf0b594-53ae-5ffe-aa05-f267d9f4fb94', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01fa2c48-95, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01fa2c48-95, col_values=(('qos', UUID('cf38723d-2b3e-40bd-b108-444780e9d632')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01fa2c48-95, col_values=(('external_ids', {'iface-id': '01fa2c48-958b-485c-b34e-b7ceb445bca4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:fa:dc', 'vm-uuid': '93367290-6fa4-4bbe-b47b-2dfa27227bed'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:58:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:27 user nova-compute[74889]: INFO os_vif [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:fa:dc,bridge_name='br-int',has_traffic_filtering=True,id=01fa2c48-958b-485c-b34e-b7ceb445bca4,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fa2c48-95')
Nov 10 11:58:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:58:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No VIF found with MAC fa:16:3e:fc:fa:dc, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:58:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-4fb1b796-4383-4aeb-9c82-b136359058d9 req-7d203277-e40f-49d9-b26f-dc68dcd9906a service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Updated VIF entry in instance network info cache for port 01fa2c48-958b-485c-b34e-b7ceb445bca4. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:58:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-4fb1b796-4383-4aeb-9c82-b136359058d9 req-7d203277-e40f-49d9-b26f-dc68dcd9906a service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Updating instance_info_cache with network_info: [{"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4fb1b796-4383-4aeb-9c82-b136359058d9 req-7d203277-e40f-49d9-b26f-dc68dcd9906a service nova] Releasing lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:58:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-13f7975e-050d-403a-bef3-81aaaf51281c req-c692dcf1-ac09-4a50-9b17-8d633626bbb5 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received event network-vif-plugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-13f7975e-050d-403a-bef3-81aaaf51281c req-c692dcf1-ac09-4a50-9b17-8d633626bbb5 service nova] Acquiring lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-13f7975e-050d-403a-bef3-81aaaf51281c req-c692dcf1-ac09-4a50-9b17-8d633626bbb5 service nova] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-13f7975e-050d-403a-bef3-81aaaf51281c req-c692dcf1-ac09-4a50-9b17-8d633626bbb5 service nova] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-13f7975e-050d-403a-bef3-81aaaf51281c req-c692dcf1-ac09-4a50-9b17-8d633626bbb5 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] No waiting events found dispatching network-vif-plugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:58:29 user nova-compute[74889]: WARNING nova.compute.manager [req-13f7975e-050d-403a-bef3-81aaaf51281c req-c692dcf1-ac09-4a50-9b17-8d633626bbb5 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received unexpected event network-vif-plugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 for instance with vm_state building and task_state spawning.
Nov 10 11:58:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-3292ee46-363b-4495-ad27-92d0831dfd23 req-2b817b2f-74c2-4aa3-8a72-5b89575d1fd1 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received event network-vif-plugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3292ee46-363b-4495-ad27-92d0831dfd23 req-2b817b2f-74c2-4aa3-8a72-5b89575d1fd1 service nova] Acquiring lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3292ee46-363b-4495-ad27-92d0831dfd23 req-2b817b2f-74c2-4aa3-8a72-5b89575d1fd1 service nova] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3292ee46-363b-4495-ad27-92d0831dfd23 req-2b817b2f-74c2-4aa3-8a72-5b89575d1fd1 service nova] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-3292ee46-363b-4495-ad27-92d0831dfd23 req-2b817b2f-74c2-4aa3-8a72-5b89575d1fd1 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] No waiting events found dispatching network-vif-plugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:58:31 user nova-compute[74889]: WARNING nova.compute.manager [req-3292ee46-363b-4495-ad27-92d0831dfd23 req-2b817b2f-74c2-4aa3-8a72-5b89575d1fd1 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received unexpected event network-vif-plugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 for instance with vm_state building and task_state spawning.
Nov 10 11:58:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:58:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:58:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Instance spawned successfully.
Nov 10 11:58:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:58:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:32 user nova-compute[74889]: INFO nova.compute.manager [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Took 7.07 seconds to spawn the instance on the hypervisor.
Nov 10 11:58:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:58:32 user nova-compute[74889]: INFO nova.compute.manager [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Took 8.20 seconds to build instance.
Nov 10 11:58:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-227b78c0-e368-472e-aa69-96997e520da4 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.329s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:33 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:58:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:33 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:58:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJKLiyMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:58:34 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:58:34 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:58:34 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cebebe3-93d8-4a79-98ba-076cde64b4cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:58:34 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c160813-308c-4738-93be-0f3f4e726f4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037] added
Nov 10 11:58:34 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.086s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf9bccb-6ca4-40db-9cd9-26fddd2753fb]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e9b2bc-c9be-4c13-b25e-f51515fe2b2e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJKLiyMb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJKLiyMb" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fd98db-7c74-469a-8675-1346bb18868e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJKLiyMb'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4891effa-868c-44b5-b929-fab24afc837c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afe3c9b-f096-402e-aaad-6949d0cd21ab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:58:34 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:58:34 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:58:34 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:58:34 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fca8d2b-b584-48cd-86f1-8b8333cb4c87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037, portal: 172.16.0.220,3260]
Nov 10 11:58:34 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037, portal: 172.16.0.220,3260] successful.
Nov 10 11:58:34 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b63f71-4c8a-4d18-9ae3-ceee1582aa7c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b27e22c-7cf5-40ca-8177-ece0c64a3130]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:58:34 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:58:34 user nova-compute[74889]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 (non-flash)
Nov 10 11:58:34 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:58:34 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:58:34 user nova-compute[74889]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 (non-flash)
Nov 10 11:58:34 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad5b582-a763-4eba-bd41-1c612acfa0cd]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:58:34 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJKLiyMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.517s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] <== connect_volume: return (1521ms) {'type': 'block', 'scsi_wwn': '23632633665663734', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632633665663734', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lazy-loading 'flavor' on Instance uuid 61077e59-6249-4a6e-b749-733ed9735bb2 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 11:58:35 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:58:35 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 11:58:35 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:58:35 user nova-compute[74889]:   <serial>be5da929-5f07-4239-98d3-1506254f1037</serial>
Nov 10 11:58:35 user nova-compute[74889]: </disk>
Nov 10 11:58:35 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] No VIF found with MAC fa:16:3e:69:9b:10, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e5b0b220-325f-4558-97e3-e7642e96b493 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.575s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:37 user nova-compute[74889]: INFO nova.compute.manager [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Detaching volume be5da929-5f07-4239-98d3-1506254f1037
Nov 10 11:58:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:37 user nova-compute[74889]: INFO nova.virt.block_device [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Attempting to driver detach volume be5da929-5f07-4239-98d3-1506254f1037 from mountpoint /dev/vdb
Nov 10 11:58:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Attempting to detach device vdb from instance 61077e59-6249-4a6e-b749-733ed9735bb2 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:58:37 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:58:37 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 11:58:37 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:58:37 user nova-compute[74889]:   <serial>be5da929-5f07-4239-98d3-1506254f1037</serial>
Nov 10 11:58:37 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 11:58:37 user nova-compute[74889]: </disk>
Nov 10 11:58:37 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:58:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Successfully detached device vdb from instance 61077e59-6249-4a6e-b749-733ed9735bb2 from the persistent domain config.
Nov 10 11:58:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61077e59-6249-4a6e-b749-733ed9735bb2 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:58:37 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:58:37 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 11:58:37 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:58:37 user nova-compute[74889]:   <serial>be5da929-5f07-4239-98d3-1506254f1037</serial>
Nov 10 11:58:37 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 11:58:37 user nova-compute[74889]: </disk>
Nov 10 11:58:37 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:58:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61077e59-6249-4a6e-b749-733ed9735bb2 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 11:58:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:58:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7563MB free_disk=25.358139038085938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "22718082-4c44-4384-8692-c216bb1a14e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "22718082-4c44-4384-8692-c216bb1a14e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6200554d-5be6-48b4-90e9-4151006d8ce3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance ff790962-c708-465c-a240-36748871cfda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 81cfb431-3aee-4081-82ba-49612a294d61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 61077e59-6249-4a6e-b749-733ed9735bb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 8296720c-3b9e-4f86-8dfc-f4d7719a1a90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance fc53bac7-d79d-4c33-af61-340b00dd8758 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 93367290-6fa4-4bbe-b47b-2dfa27227bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 22718082-4c44-4384-8692-c216bb1a14e4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.418s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:58:40 user nova-compute[74889]: INFO nova.compute.claims [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Claim successful on node user
Nov 10 11:58:40 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:58:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:58:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG nova.policy [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa5f0e22f91049d6ae70a72bc14df5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e625bfb83b44435db8d8935883a7995f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:58:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Creating image(s)
Nov 10 11:58:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "/opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "/opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "/opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.207s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk 1073741824" returned: 0 in 0.059s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Successfully created port: 8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Cannot resize image /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Ensure instance console log exists: /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:58:41 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Successfully updated port: 8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquired lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-00af40c7-a038-4f28-b088-15b9ea6c9eb3 req-2fd7a01d-1769-4ee8-b1a7-bdec255b3f7d service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Received event network-changed-8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-00af40c7-a038-4f28-b088-15b9ea6c9eb3 req-2fd7a01d-1769-4ee8-b1a7-bdec255b3f7d service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Refreshing instance network info cache due to event network-changed-8d58ace8-d425-4267-8f74-885aced29342. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-00af40c7-a038-4f28-b088-15b9ea6c9eb3 req-2fd7a01d-1769-4ee8-b1a7-bdec255b3f7d service nova] Acquiring lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updating instance_info_cache with network_info: [{"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Updating instance_info_cache with network_info: [{"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Releasing lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Instance network_info: |[{"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-00af40c7-a038-4f28-b088-15b9ea6c9eb3 req-2fd7a01d-1769-4ee8-b1a7-bdec255b3f7d service nova] Acquired lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.neutron [req-00af40c7-a038-4f28-b088-15b9ea6c9eb3 req-2fd7a01d-1769-4ee8-b1a7-bdec255b3f7d service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Refreshing network info cache for port 8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Start _get_guest_xml network_info=[{"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:58:42 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:58:42 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-416891570',display_name='tempest-ServersNegativeTestJSON-server-416891570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-416891570',id=17,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e625bfb83b44435db8d8935883a7995f',ramdisk_id='',reservation_id='r-xydacopi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1939998126',owner_user_name='tempest-ServersNegativeTestJSON-1939998126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:58:41Z,user_data=None,user_id='aa5f0e22f91049d6ae70a72bc14df5c7',uuid=22718082-4c44-4384-8692-c216bb1a14e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converting VIF {"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8a:65,bridge_name='br-int',has_traffic_filtering=True,id=8d58ace8-d425-4267-8f74-885aced29342,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d58ace8-d4') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lazy-loading 'pci_devices' on Instance uuid 22718082-4c44-4384-8692-c216bb1a14e4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:58:42 user nova-compute[74889]:   <uuid>22718082-4c44-4384-8692-c216bb1a14e4</uuid>
Nov 10 11:58:42 user nova-compute[74889]:   <name>instance-00000011</name>
Nov 10 11:58:42 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:58:42 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:58:42 user nova-compute[74889]:   <metadata>
Nov 10 11:58:42 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:58:42 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:58:42 user nova-compute[74889]:       <nova:name>tempest-ServersNegativeTestJSON-server-416891570</nova:name>
Nov 10 11:58:42 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:58:42</nova:creationTime>
Nov 10 11:58:42 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:58:42 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:58:42 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:58:42 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:58:42 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:58:42 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:58:42 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:58:42 user nova-compute[74889]:       <nova:owner>
Nov 10 11:58:42 user nova-compute[74889]:         <nova:user uuid="aa5f0e22f91049d6ae70a72bc14df5c7">tempest-ServersNegativeTestJSON-1939998126-project-member</nova:user>
Nov 10 11:58:42 user nova-compute[74889]:         <nova:project uuid="e625bfb83b44435db8d8935883a7995f">tempest-ServersNegativeTestJSON-1939998126</nova:project>
Nov 10 11:58:42 user nova-compute[74889]:       </nova:owner>
Nov 10 11:58:42 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:58:42 user nova-compute[74889]:       <nova:ports>
Nov 10 11:58:42 user nova-compute[74889]:         <nova:port uuid="8d58ace8-d425-4267-8f74-885aced29342">
Nov 10 11:58:42 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 11:58:42 user nova-compute[74889]:         </nova:port>
Nov 10 11:58:42 user nova-compute[74889]:       </nova:ports>
Nov 10 11:58:42 user nova-compute[74889]:     </nova:instance>
Nov 10 11:58:42 user nova-compute[74889]:   </metadata>
Nov 10 11:58:42 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:58:42 user nova-compute[74889]:     <system>
Nov 10 11:58:42 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:58:42 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:58:42 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:58:42 user nova-compute[74889]:       <entry name="serial">22718082-4c44-4384-8692-c216bb1a14e4</entry>
Nov 10 11:58:42 user nova-compute[74889]:       <entry name="uuid">22718082-4c44-4384-8692-c216bb1a14e4</entry>
Nov 10 11:58:42 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:58:42 user nova-compute[74889]:     </system>
Nov 10 11:58:42 user nova-compute[74889]:   </sysinfo>
Nov 10 11:58:42 user nova-compute[74889]:   <os>
Nov 10 11:58:42 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:58:42 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:58:42 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:58:42 user nova-compute[74889]:   </os>
Nov 10 11:58:42 user nova-compute[74889]:   <features>
Nov 10 11:58:42 user nova-compute[74889]:     <acpi/>
Nov 10 11:58:42 user nova-compute[74889]:     <apic/>
Nov 10 11:58:42 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:58:42 user nova-compute[74889]:   </features>
Nov 10 11:58:42 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:58:42 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:58:42 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:58:42 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:58:42 user nova-compute[74889]:   </clock>
Nov 10 11:58:42 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:58:42 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:58:42 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:58:42 user nova-compute[74889]:   </cpu>
Nov 10 11:58:42 user nova-compute[74889]:   <devices>
Nov 10 11:58:42 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:58:42 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:58:42 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk"/>
Nov 10 11:58:42 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:58:42 user nova-compute[74889]:     </disk>
Nov 10 11:58:42 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:58:42 user nova-compute[74889]:       <mac address="fa:16:3e:9a:8a:65"/>
Nov 10 11:58:42 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:58:42 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:58:42 user nova-compute[74889]:       <target dev="tap8d58ace8-d4"/>
Nov 10 11:58:42 user nova-compute[74889]:     </interface>
Nov 10 11:58:42 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:58:42 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/console.log" append="off"/>
Nov 10 11:58:42 user nova-compute[74889]:     </serial>
Nov 10 11:58:42 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:58:42 user nova-compute[74889]:     <video>
Nov 10 11:58:42 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:58:42 user nova-compute[74889]:     </video>
Nov 10 11:58:42 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:58:42 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:58:42 user nova-compute[74889]:     </rng>
Nov 10 11:58:42 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:58:42 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:58:42 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:58:42 user nova-compute[74889]:     </memballoon>
Nov 10 11:58:42 user nova-compute[74889]:   </devices>
Nov 10 11:58:42 user nova-compute[74889]: </domain>
Nov 10 11:58:42 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-416891570',display_name='tempest-ServersNegativeTestJSON-server-416891570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-416891570',id=17,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e625bfb83b44435db8d8935883a7995f',ramdisk_id='',reservation_id='r-xydacopi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1939998126',owner_user_name='tempest-ServersNegativeTestJSON-1939998126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:58:41Z,user_data=None,user_id='aa5f0e22f91049d6ae70a72bc14df5c7',uuid=22718082-4c44-4384-8692-c216bb1a14e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converting VIF {"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8a:65,bridge_name='br-int',has_traffic_filtering=True,id=8d58ace8-d425-4267-8f74-885aced29342,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d58ace8-d4') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG os_vif [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8a:65,bridge_name='br-int',has_traffic_filtering=True,id=8d58ace8-d425-4267-8f74-885aced29342,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d58ace8-d4') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cbaac6b-2061-5453-b320-afc512fa09bd', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d58ace8-d4, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d58ace8-d4, col_values=(('qos', UUID('55ce64eb-d1ba-4991-a543-776c27853505')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d58ace8-d4, col_values=(('external_ids', {'iface-id': '8d58ace8-d425-4267-8f74-885aced29342', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:8a:65', 'vm-uuid': '22718082-4c44-4384-8692-c216bb1a14e4'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:42 user nova-compute[74889]: INFO os_vif [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:8a:65,bridge_name='br-int',has_traffic_filtering=True,id=8d58ace8-d425-4267-8f74-885aced29342,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d58ace8-d4')
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:58:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] No VIF found with MAC fa:16:3e:9a:8a:65, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:58:43 user nova-compute[74889]: DEBUG nova.network.neutron [req-00af40c7-a038-4f28-b088-15b9ea6c9eb3 req-2fd7a01d-1769-4ee8-b1a7-bdec255b3f7d service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Updated VIF entry in instance network info cache for port 8d58ace8-d425-4267-8f74-885aced29342. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:58:43 user nova-compute[74889]: DEBUG nova.network.neutron [req-00af40c7-a038-4f28-b088-15b9ea6c9eb3 req-2fd7a01d-1769-4ee8-b1a7-bdec255b3f7d service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Updating instance_info_cache with network_info: [{"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-00af40c7-a038-4f28-b088-15b9ea6c9eb3 req-2fd7a01d-1769-4ee8-b1a7-bdec255b3f7d service nova] Releasing lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:58:43 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:58:43 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-82f70642-b710-48bb-8fea-96f6068328a3 req-93e0dc72-39e7-427b-b9b3-53c717d4c67c service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Received event network-vif-plugged-8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-82f70642-b710-48bb-8fea-96f6068328a3 req-93e0dc72-39e7-427b-b9b3-53c717d4c67c service nova] Acquiring lock "22718082-4c44-4384-8692-c216bb1a14e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-82f70642-b710-48bb-8fea-96f6068328a3 req-93e0dc72-39e7-427b-b9b3-53c717d4c67c service nova] Lock "22718082-4c44-4384-8692-c216bb1a14e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-82f70642-b710-48bb-8fea-96f6068328a3 req-93e0dc72-39e7-427b-b9b3-53c717d4c67c service nova] Lock "22718082-4c44-4384-8692-c216bb1a14e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-82f70642-b710-48bb-8fea-96f6068328a3 req-93e0dc72-39e7-427b-b9b3-53c717d4c67c service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] No waiting events found dispatching network-vif-plugged-8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:58:44 user nova-compute[74889]: WARNING nova.compute.manager [req-82f70642-b710-48bb-8fea-96f6068328a3 req-93e0dc72-39e7-427b-b9b3-53c717d4c67c service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Received unexpected event network-vif-plugged-8d58ace8-d425-4267-8f74-885aced29342 for instance with vm_state building and task_state spawning.
Nov 10 11:58:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:58:46 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Instance spawned successfully.
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:58:46 user nova-compute[74889]: INFO nova.compute.manager [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-72f00daa-fd85-4875-bddd-f0626a27305b req-4815602e-b494-4a0e-92a2-c47a5e1650fe service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Received event network-vif-plugged-8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-72f00daa-fd85-4875-bddd-f0626a27305b req-4815602e-b494-4a0e-92a2-c47a5e1650fe service nova] Acquiring lock "22718082-4c44-4384-8692-c216bb1a14e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-72f00daa-fd85-4875-bddd-f0626a27305b req-4815602e-b494-4a0e-92a2-c47a5e1650fe service nova] Lock "22718082-4c44-4384-8692-c216bb1a14e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-72f00daa-fd85-4875-bddd-f0626a27305b req-4815602e-b494-4a0e-92a2-c47a5e1650fe service nova] Lock "22718082-4c44-4384-8692-c216bb1a14e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-72f00daa-fd85-4875-bddd-f0626a27305b req-4815602e-b494-4a0e-92a2-c47a5e1650fe service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] No waiting events found dispatching network-vif-plugged-8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:58:46 user nova-compute[74889]: WARNING nova.compute.manager [req-72f00daa-fd85-4875-bddd-f0626a27305b req-4815602e-b494-4a0e-92a2-c47a5e1650fe service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Received unexpected event network-vif-plugged-8d58ace8-d425-4267-8f74-885aced29342 for instance with vm_state building and task_state spawning.
Nov 10 11:58:46 user nova-compute[74889]: INFO nova.compute.manager [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Took 7.23 seconds to build instance.
Nov 10 11:58:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1ba515cc-4149-4288-a8cc-3b25c368da0f tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "22718082-4c44-4384-8692-c216bb1a14e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.356s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:58:48 user nova-compute[74889]: INFO nova.compute.claims [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Claim successful on node user
Nov 10 11:58:48 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:58:48 user nova-compute[74889]: DEBUG nova.network.neutron [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:58:48 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:58:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG nova.policy [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02ca978ddde34a69944046e0ca2ad504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ecf83da57e42c893ec51707cc19d00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:58:49 user nova-compute[74889]: INFO nova.virt.block_device [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Booting with volume e9f23384-8a98-40fd-af08-babb064b0c5a at /dev/vda
Nov 10 11:58:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG os_brick.utils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa6884e-3393-4bec-812b-b4ce0de72d0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba652a68-dd82-47e8-9582-20295da73890]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efdcc4f-8e37-455f-9f9a-e2abc5be4f9d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a86ae66-60f1-4708-9764-6ebb669d005d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:58:49 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9add1374-0878-4cb5-aea1-d890353137e9]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG os_brick.utils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating existing volume attachment record: 114a4dbe-6012-4434-965f-978d19097a74 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:49 user nova-compute[74889]: INFO nova.compute.manager [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Terminating instance
Nov 10 11:58:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:49 user nova-compute[74889]: DEBUG nova.network.neutron [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Successfully created port: cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-31203756-ab4a-4fb0-a2e5-6f6e9388ce73 req-e54a1cbd-1c14-4cb7-8dc3-fb3df586672a service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Received event network-vif-unplugged-1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-31203756-ab4a-4fb0-a2e5-6f6e9388ce73 req-e54a1cbd-1c14-4cb7-8dc3-fb3df586672a service nova] Acquiring lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-31203756-ab4a-4fb0-a2e5-6f6e9388ce73 req-e54a1cbd-1c14-4cb7-8dc3-fb3df586672a service nova] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-31203756-ab4a-4fb0-a2e5-6f6e9388ce73 req-e54a1cbd-1c14-4cb7-8dc3-fb3df586672a service nova] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-31203756-ab4a-4fb0-a2e5-6f6e9388ce73 req-e54a1cbd-1c14-4cb7-8dc3-fb3df586672a service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] No waiting events found dispatching network-vif-unplugged-1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-31203756-ab4a-4fb0-a2e5-6f6e9388ce73 req-e54a1cbd-1c14-4cb7-8dc3-fb3df586672a service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Received event network-vif-unplugged-1ace983c-910d-402d-ad18-a7bad9021c70 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 11:58:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Instance destroyed successfully.
Nov 10 11:58:50 user nova-compute[74889]: DEBUG nova.objects.instance [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lazy-loading 'resources' on Instance uuid 8296720c-3b9e-4f86-8dfc-f4d7719a1a90 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1569376151',display_name='tempest-VolumesActionsTest-instance-1569376151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1569376151',id=12,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:57:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c664edf4b1844ed9592c9f5851b4bff',ramdisk_id='',reservation_id='r-ufdps3ls',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1744369685',owner_user_name='tempest-VolumesActionsTest-1744369685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:57:09Z,user_data=None,user_id='c0a2bf1ce37a4d05b3179b2e8573c3e1',uuid=8296720c-3b9e-4f86-8dfc-f4d7719a1a90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1ace983c-910d-402d-ad18-a7bad9021c70", "address": "fa:16:3e:22:e8:97", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace983c-91", "ovs_interfaceid": "1ace983c-910d-402d-ad18-a7bad9021c70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converting VIF {"id": "1ace983c-910d-402d-ad18-a7bad9021c70", "address": "fa:16:3e:22:e8:97", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1ace983c-91", "ovs_interfaceid": "1ace983c-910d-402d-ad18-a7bad9021c70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=1ace983c-910d-402d-ad18-a7bad9021c70,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace983c-91') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG os_vif [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=1ace983c-910d-402d-ad18-a7bad9021c70,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace983c-91') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1ace983c-91, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8e65260-0abc-4393-8e85-806f5cc8883b) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:50 user nova-compute[74889]: INFO os_vif [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:e8:97,bridge_name='br-int',has_traffic_filtering=True,id=1ace983c-910d-402d-ad18-a7bad9021c70,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1ace983c-91')
Nov 10 11:58:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Deleting instance files /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90_del
Nov 10 11:58:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Deletion of /opt/stack/data/nova/instances/8296720c-3b9e-4f86-8dfc-f4d7719a1a90_del complete
Nov 10 11:58:50 user nova-compute[74889]: INFO nova.compute.manager [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 10 11:58:50 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 11:58:50 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.network.neutron [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Successfully updated port: cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquired lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.network.neutron [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.network.neutron [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:51 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Took 0.53 seconds to deallocate network for instance.
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-ca50c6a4-3674-44be-8d30-271bd11898ab req-c2445271-7a92-4dec-8aa0-a9ef8812cac1 service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Received event network-vif-deleted-1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:51 user nova-compute[74889]: INFO nova.compute.manager [req-ca50c6a4-3674-44be-8d30-271bd11898ab req-c2445271-7a92-4dec-8aa0-a9ef8812cac1 service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Neutron deleted interface 1ace983c-910d-402d-ad18-a7bad9021c70; detaching it from the instance and deleting it from the info cache
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-ca50c6a4-3674-44be-8d30-271bd11898ab req-c2445271-7a92-4dec-8aa0-a9ef8812cac1 service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-ca50c6a4-3674-44be-8d30-271bd11898ab req-c2445271-7a92-4dec-8aa0-a9ef8812cac1 service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Detach interface failed, port_id=1ace983c-910d-402d-ad18-a7bad9021c70, reason: Instance 8296720c-3b9e-4f86-8dfc-f4d7719a1a90 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.network.neutron [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating instance_info_cache with network_info: [{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Releasing lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.compute.manager [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Instance network_info: |[{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:58:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.607s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:51 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Deleted allocations for instance 8296720c-3b9e-4f86-8dfc-f4d7719a1a90
Nov 10 11:58:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-63f5ccbb-90a7-4b3f-9769-6e1962c41fac tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.375s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Received event network-vif-plugged-1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] Acquiring lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] Lock "8296720c-3b9e-4f86-8dfc-f4d7719a1a90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] No waiting events found dispatching network-vif-plugged-1ace983c-910d-402d-ad18-a7bad9021c70 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:58:52 user nova-compute[74889]: WARNING nova.compute.manager [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] [instance: 8296720c-3b9e-4f86-8dfc-f4d7719a1a90] Received unexpected event network-vif-plugged-1ace983c-910d-402d-ad18-a7bad9021c70 for instance with vm_state deleted and task_state None.
Nov 10 11:58:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-changed-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Refreshing instance network info cache due to event network-changed-cf06308d-3f2e-40e2-b778-561b0c14eea0. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] Acquiring lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] Acquired lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG nova.network.neutron [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Refreshing network info cache for port cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG nova.network.neutron [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updated VIF entry in instance network info cache for port cf06308d-3f2e-40e2-b778-561b0c14eea0. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG nova.network.neutron [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating instance_info_cache with network_info: [{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:58:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e8ae14d7-7fd9-4828-93a3-77eb27af8952 req-77e8995a-5f4e-4ace-b067-b1e4909c1839 service nova] Releasing lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:58:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:57 user nova-compute[74889]: DEBUG nova.objects.instance [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'flavor' on Instance uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:58:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:58:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:58:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:58:57 user nova-compute[74889]: INFO nova.compute.manager [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Attaching volume 4eb06668-3486-48c6-9f64-1df49ce73aad to /dev/vdb
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.utils [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c0bc59-fc14-4dac-bc84-2ac513eeb076]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[739f5173-65fd-47de-8102-e0c67860b6eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc1b575-27c6-419c-88fc-919099c4ada2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[38664be7-2699-4525-891c-3819d2cbe4b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:58:58 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8336299b-f336-44d9-a768-d2f1cbc51e87]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.utils [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updating existing volume attachment record: a4a0bff4-7be7-4191-83ab-080ad7b30f11 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:58:58 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 61077e59-6249-4a6e-b749-733ed9735bb2 is timed out.
Nov 10 11:58:58 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Successfully detached device vdb from instance 61077e59-6249-4a6e-b749-733ed9735bb2 from the live domain config.
Nov 10 11:58:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJKLiyMb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:58:58 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33195dd-f708-4c72-b1d3-006c8e49c986]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:58:58 user nova-compute[74889]: No targets found.
Nov 10 11:58:58 user nova-compute[74889]: iSNS:
Nov 10 11:58:58 user nova-compute[74889]: No targets found.
Nov 10 11:58:58 user nova-compute[74889]: STATIC:
Nov 10 11:58:58 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9
Nov 10 11:58:58 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:58:58 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:58:58 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584
Nov 10 11:58:58 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:58:58 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:58:58 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037
Nov 10 11:58:58 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:58:58 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:58:58 user nova-compute[74889]: FIRMWARE:
Nov 10 11:58:58 user nova-compute[74889]: No targets found.
Nov 10 11:58:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:58:58 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:58:58 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eff7ce0-003e-407a-a1dd-d3a342842be9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[899e91e7-ad77-4e3a-9c5f-487b55437fc3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:58:58 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:58:58 user nova-compute[74889]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 (non-flash)
Nov 10 11:58:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:58:58 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:58:58 user nova-compute[74889]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 (non-flash)
Nov 10 11:58:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa39828bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98705e6-5067-419b-b288-e92102d70032]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6acb23a-d3d6-423a-b518-9a3edecf4ac3]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[950ed06b-6e36-4a54-b4d6-1366ecaf1ba6]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc725420-771d-4032-831d-ded7a0851a78]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e21790-1bb7-4209-b6db-f34240b6bb48]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b9f80e-05ad-478c-9494-90f8b9e9cd72]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037, portal: 172.16.0.220,3260]
Nov 10 11:58:58 user nova-compute[74889]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037, portal: 172.16.0.220,3260] successful.
Nov 10 11:58:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be5da929-5f07-4239-98d3-1506254f1037 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b9b3e8-d4d2-43a3-b6eb-e49523bcd4c3]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] <== disconnect_volume: return (310ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:58:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:58:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:58:59 user nova-compute[74889]: DEBUG nova.objects.instance [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lazy-loading 'flavor' on Instance uuid 61077e59-6249-4a6e-b749-733ed9735bb2 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:58:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d7279d9d-d846-461b-bde4-22c8c5fbbfb4 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.116s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:59:14 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Creating image(s)
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Ensure instance console log exists: /opt/stack/data/nova/instances/78fe06d2-9353-4b9a-8e34-2261f2f77fce/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Start _get_guest_xml network_info=[{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuiXrEFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78fe06d2-9353-4b9a-8e34-2261f2f77fce', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9f23384-8a98-40fd-af08-babb064b0c5a', 'serial': 'e9f23384-8a98-40fd-af08-babb064b0c5a'}, 'disk_bus': 'virtio', 'attachment_id': '114a4dbe-6012-4434-965f-978d19097a74', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:59:14 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:14 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuiXrEFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:59:14 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:59:14 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:59:14 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2ab1d2-abc9-4a82-be31-2a9473440b1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:59:14 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31ef0ab-a953-4c88-b366-4ba2727b9c1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a] added
Nov 10 11:59:14 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1a88de-3464-455b-a996-9aae2798d7cc]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eac7216-6a7b-4864-8eee-aee8c04cbf7e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NuiXrEFh {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NuiXrEFh" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[77477131-cff2-4fc6-9bda-868b7959fabc]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NuiXrEFh'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d34aa8-e031-4a6d-bd76-9223f70f33f8]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe4b76f-5fd4-4fe2-8fba-0791be6e1eb9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:14 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:14 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:14 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:14 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c8a754-0a44-409a-af0a-2029363d0a37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260]
Nov 10 11:59:14 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260] successful.
Nov 10 11:59:14 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.074s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc12ed5-6d2b-4961-9987-0ffd24f7e42a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[baff3259-eaee-44b6-836a-9f12c8a7875b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:14 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:14 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:14 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:14 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:14 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:14 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a16e47-3fae-4658-b23f-20a90a596183]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:14 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuiXrEFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23561353032626162', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561353032626162', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1185042267',display_name='tempest-TestShelveInstance-server-1185042267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1185042267',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPodj8RVFRnA92GtRbLa/y5HXflW20ag/voq9r2ZeH0NpyQGRj3+WFhoAPh5CJmLOMRCKMA5LPKPCnUOg3GfcAzioslG0YE6FCboauaqDG5i1iJyS8KJnGXK3pKJSV0HRA==',key_name='tempest-TestShelveInstance-551479707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63ecf83da57e42c893ec51707cc19d00',ramdisk_id='',reservation_id='r-5a4kdpl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1459906128',owner_user_name='tempest-TestShelveInstance-1459906128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:58:49Z,user_data=None,user_id='02ca978ddde34a69944046e0ca2ad504',uuid=78fe06d2-9353-4b9a-8e34-2261f2f77fce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converting VIF {"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG nova.objects.instance [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lazy-loading 'pci_devices' on Instance uuid 78fe06d2-9353-4b9a-8e34-2261f2f77fce {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:59:15 user nova-compute[74889]:   <uuid>78fe06d2-9353-4b9a-8e34-2261f2f77fce</uuid>
Nov 10 11:59:15 user nova-compute[74889]:   <name>instance-00000012</name>
Nov 10 11:59:15 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:59:15 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:59:15 user nova-compute[74889]:   <metadata>
Nov 10 11:59:15 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:59:15 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:59:15 user nova-compute[74889]:       <nova:name>tempest-TestShelveInstance-server-1185042267</nova:name>
Nov 10 11:59:15 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:59:14</nova:creationTime>
Nov 10 11:59:15 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:59:15 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:59:15 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:59:15 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:59:15 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:59:15 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:59:15 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:59:15 user nova-compute[74889]:       <nova:owner>
Nov 10 11:59:15 user nova-compute[74889]:         <nova:user uuid="02ca978ddde34a69944046e0ca2ad504">tempest-TestShelveInstance-1459906128-project-member</nova:user>
Nov 10 11:59:15 user nova-compute[74889]:         <nova:project uuid="63ecf83da57e42c893ec51707cc19d00">tempest-TestShelveInstance-1459906128</nova:project>
Nov 10 11:59:15 user nova-compute[74889]:       </nova:owner>
Nov 10 11:59:15 user nova-compute[74889]:       <nova:ports>
Nov 10 11:59:15 user nova-compute[74889]:         <nova:port uuid="cf06308d-3f2e-40e2-b778-561b0c14eea0">
Nov 10 11:59:15 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 11:59:15 user nova-compute[74889]:         </nova:port>
Nov 10 11:59:15 user nova-compute[74889]:       </nova:ports>
Nov 10 11:59:15 user nova-compute[74889]:     </nova:instance>
Nov 10 11:59:15 user nova-compute[74889]:   </metadata>
Nov 10 11:59:15 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:59:15 user nova-compute[74889]:     <system>
Nov 10 11:59:15 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:59:15 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:59:15 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:59:15 user nova-compute[74889]:       <entry name="serial">78fe06d2-9353-4b9a-8e34-2261f2f77fce</entry>
Nov 10 11:59:15 user nova-compute[74889]:       <entry name="uuid">78fe06d2-9353-4b9a-8e34-2261f2f77fce</entry>
Nov 10 11:59:15 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:59:15 user nova-compute[74889]:     </system>
Nov 10 11:59:15 user nova-compute[74889]:   </sysinfo>
Nov 10 11:59:15 user nova-compute[74889]:   <os>
Nov 10 11:59:15 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:59:15 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:59:15 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:59:15 user nova-compute[74889]:   </os>
Nov 10 11:59:15 user nova-compute[74889]:   <features>
Nov 10 11:59:15 user nova-compute[74889]:     <acpi/>
Nov 10 11:59:15 user nova-compute[74889]:     <apic/>
Nov 10 11:59:15 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:59:15 user nova-compute[74889]:   </features>
Nov 10 11:59:15 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:59:15 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:59:15 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:59:15 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:59:15 user nova-compute[74889]:   </clock>
Nov 10 11:59:15 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:59:15 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:59:15 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:59:15 user nova-compute[74889]:   </cpu>
Nov 10 11:59:15 user nova-compute[74889]:   <devices>
Nov 10 11:59:15 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 11:59:15 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:59:15 user nova-compute[74889]:       <source dev="/dev/sdb"/>
Nov 10 11:59:15 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:59:15 user nova-compute[74889]:       <serial>e9f23384-8a98-40fd-af08-babb064b0c5a</serial>
Nov 10 11:59:15 user nova-compute[74889]:     </disk>
Nov 10 11:59:15 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:59:15 user nova-compute[74889]:       <mac address="fa:16:3e:12:a0:f5"/>
Nov 10 11:59:15 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:59:15 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:59:15 user nova-compute[74889]:       <target dev="tapcf06308d-3f"/>
Nov 10 11:59:15 user nova-compute[74889]:     </interface>
Nov 10 11:59:15 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:59:15 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/78fe06d2-9353-4b9a-8e34-2261f2f77fce/console.log" append="off"/>
Nov 10 11:59:15 user nova-compute[74889]:     </serial>
Nov 10 11:59:15 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:59:15 user nova-compute[74889]:     <video>
Nov 10 11:59:15 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:59:15 user nova-compute[74889]:     </video>
Nov 10 11:59:15 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:59:15 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:59:15 user nova-compute[74889]:     </rng>
Nov 10 11:59:15 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:59:15 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:59:15 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:59:15 user nova-compute[74889]:     </memballoon>
Nov 10 11:59:15 user nova-compute[74889]:   </devices>
Nov 10 11:59:15 user nova-compute[74889]: </domain>
Nov 10 11:59:15 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1185042267',display_name='tempest-TestShelveInstance-server-1185042267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1185042267',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPodj8RVFRnA92GtRbLa/y5HXflW20ag/voq9r2ZeH0NpyQGRj3+WFhoAPh5CJmLOMRCKMA5LPKPCnUOg3GfcAzioslG0YE6FCboauaqDG5i1iJyS8KJnGXK3pKJSV0HRA==',key_name='tempest-TestShelveInstance-551479707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63ecf83da57e42c893ec51707cc19d00',ramdisk_id='',reservation_id='r-5a4kdpl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1459906128',owner_user_name='tempest-TestShelveInstance-1459906128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:58:49Z,user_data=None,user_id='02ca978ddde34a69944046e0ca2ad504',uuid=78fe06d2-9353-4b9a-8e34-2261f2f77fce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converting VIF {"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG os_vif [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c27994cf-fb8b-53a5-bcd9-cd5d88e99765', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf06308d-3f, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf06308d-3f, col_values=(('qos', UUID('9c97b8c3-e86e-4695-a93f-b5209a7e15d8')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf06308d-3f, col_values=(('external_ids', {'iface-id': 'cf06308d-3f2e-40e2-b778-561b0c14eea0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:a0:f5', 'vm-uuid': '78fe06d2-9353-4b9a-8e34-2261f2f77fce'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:16 user nova-compute[74889]: INFO os_vif [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f')
Nov 10 11:59:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:59:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] No VIF found with MAC fa:16:3e:12:a0:f5, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG nova.compute.manager [req-11de47f8-5ec3-4105-9def-f615a83ea7bf req-649c5042-b651-408a-b263-675ccb12b091 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-11de47f8-5ec3-4105-9def-f615a83ea7bf req-649c5042-b651-408a-b263-675ccb12b091 service nova] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-11de47f8-5ec3-4105-9def-f615a83ea7bf req-649c5042-b651-408a-b263-675ccb12b091 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-11de47f8-5ec3-4105-9def-f615a83ea7bf req-649c5042-b651-408a-b263-675ccb12b091 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG nova.compute.manager [req-11de47f8-5ec3-4105-9def-f615a83ea7bf req-649c5042-b651-408a-b263-675ccb12b091 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] No waiting events found dispatching network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:59:17 user nova-compute[74889]: WARNING nova.compute.manager [req-11de47f8-5ec3-4105-9def-f615a83ea7bf req-649c5042-b651-408a-b263-675ccb12b091 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received unexpected event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 for instance with vm_state building and task_state spawning.
Nov 10 11:59:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:59:19 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Instance spawned successfully.
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:19 user nova-compute[74889]: INFO nova.compute.manager [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:59:19 user nova-compute[74889]: INFO nova.compute.manager [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Took 31.27 seconds to build instance.
Nov 10 11:59:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edbfc228-cf68-4d4a-b3b0-da78ed953650 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.371s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-5fb27904-d315-4dc9-837e-77f0696deb3c req-69b726f3-2b79-4968-a4e6-374548c50514 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5fb27904-d315-4dc9-837e-77f0696deb3c req-69b726f3-2b79-4968-a4e6-374548c50514 service nova] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5fb27904-d315-4dc9-837e-77f0696deb3c req-69b726f3-2b79-4968-a4e6-374548c50514 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5fb27904-d315-4dc9-837e-77f0696deb3c req-69b726f3-2b79-4968-a4e6-374548c50514 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-5fb27904-d315-4dc9-837e-77f0696deb3c req-69b726f3-2b79-4968-a4e6-374548c50514 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] No waiting events found dispatching network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:59:19 user nova-compute[74889]: WARNING nova.compute.manager [req-5fb27904-d315-4dc9-837e-77f0696deb3c req-69b726f3-2b79-4968-a4e6-374548c50514 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received unexpected event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 for instance with vm_state active and task_state None.
Nov 10 11:59:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRLpXniC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:59:22 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:59:22 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:59:22 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[49662291-d7a3-48b3-9b04-e4ddabd429a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:59:22 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb8ae39-f441-474a-84d4-c470536c76ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad] added
Nov 10 11:59:22 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec0cebd-e814-48fb-9599-b688b94c93d8]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3906ba6-26ee-49fe-9514-2d4e1b034693]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRLpXniC {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRLpXniC" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5da30b-2d67-450b-b42a-3661662422d0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wRLpXniC'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7a32e1-e78e-4df0-89d8-122beca5ca5c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79347f6-a2e9-466d-a916-7a1cf8a77cec]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:22 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:22 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:22 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:22 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:22 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:22 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:59:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --login" returned: 0 in 1.077s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b682175f-1a78-4841-bc87-cd1d9e4590b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260]
Nov 10 11:59:23 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260] successful.
Nov 10 11:59:23 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba00615-b0bf-45a5-a912-f6f846d86180]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[df45570b-eb13-484a-959e-f1861141bb21]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:23 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:23 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:23 user nova-compute[74889]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 11:59:23 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:23 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:23 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:23 user nova-compute[74889]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 11:59:23 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.274s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d2020b-a106-4986-a347-d25896a16b47]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:23 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:59:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:59:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRLpXniC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 11:59:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.302s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:59:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] <== connect_volume: return (2303ms) {'type': 'block', 'scsi_wwn': '23439653134313836', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:59:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439653134313836', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 11:59:24 user nova-compute[74889]: DEBUG nova.objects.instance [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'flavor' on Instance uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 11:59:24 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:59:24 user nova-compute[74889]:   <source dev="/dev/sdc"/>
Nov 10 11:59:24 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:59:24 user nova-compute[74889]:   <serial>4eb06668-3486-48c6-9f64-1df49ce73aad</serial>
Nov 10 11:59:24 user nova-compute[74889]: </disk>
Nov 10 11:59:24 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 11:59:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:59:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:59:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] No VIF found with MAC fa:16:3e:fe:b2:5b, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:59:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c22aa89b-edc9-46db-881f-8ba7f3e32e84 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.559s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "99116b0a-7426-4846-9a4b-dcf0bba5409f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:59:29 user nova-compute[74889]: INFO nova.compute.claims [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Claim successful on node user
Nov 10 11:59:29 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:59:29 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:59:29 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:59:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG nova.policy [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd028f217bd5b4a3994139d537c623bc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f4a33c330842ba9dca41b5a174a07d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:59:30 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Creating image(s)
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "/opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "/opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "/opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.228s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk 1073741824" returned: 0 in 0.057s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Successfully created port: fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Cannot resize image /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Ensure instance console log exists: /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Successfully updated port: fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "refresh_cache-99116b0a-7426-4846-9a4b-dcf0bba5409f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquired lock "refresh_cache-99116b0a-7426-4846-9a4b-dcf0bba5409f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-d0a9db50-3326-4ed3-8002-802093706a84 req-7c1457f7-9340-4ad0-8902-ba4a54fc82df service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Received event network-changed-fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-d0a9db50-3326-4ed3-8002-802093706a84 req-7c1457f7-9340-4ad0-8902-ba4a54fc82df service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Refreshing instance network info cache due to event network-changed-fd870488-1a98-47e6-8f24-9be244058542. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d0a9db50-3326-4ed3-8002-802093706a84 req-7c1457f7-9340-4ad0-8902-ba4a54fc82df service nova] Acquiring lock "refresh_cache-99116b0a-7426-4846-9a4b-dcf0bba5409f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Updating instance_info_cache with network_info: [{"id": "fd870488-1a98-47e6-8f24-9be244058542", "address": "fa:16:3e:f3:16:90", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd870488-1a", "ovs_interfaceid": "fd870488-1a98-47e6-8f24-9be244058542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Releasing lock "refresh_cache-99116b0a-7426-4846-9a4b-dcf0bba5409f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Instance network_info: |[{"id": "fd870488-1a98-47e6-8f24-9be244058542", "address": "fa:16:3e:f3:16:90", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd870488-1a", "ovs_interfaceid": "fd870488-1a98-47e6-8f24-9be244058542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d0a9db50-3326-4ed3-8002-802093706a84 req-7c1457f7-9340-4ad0-8902-ba4a54fc82df service nova] Acquired lock "refresh_cache-99116b0a-7426-4846-9a4b-dcf0bba5409f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-d0a9db50-3326-4ed3-8002-802093706a84 req-7c1457f7-9340-4ad0-8902-ba4a54fc82df service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Refreshing network info cache for port fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Start _get_guest_xml network_info=[{"id": "fd870488-1a98-47e6-8f24-9be244058542", "address": "fa:16:3e:f3:16:90", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd870488-1a", "ovs_interfaceid": "fd870488-1a98-47e6-8f24-9be244058542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:59:31 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:31 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1205981455',display_name='tempest-VolumesAdminNegativeTest-server-1205981455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1205981455',id=19,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74f4a33c330842ba9dca41b5a174a07d',ramdisk_id='',reservation_id='r-ct11cshw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-35604331',owner_user_name='tempest-VolumesAdminNegativeTest-35604331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:59:30Z,user_data=None,user_id='d028f217bd5b4a3994139d537c623bc5',uuid=99116b0a-7426-4846-9a4b-dcf0bba5409f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd870488-1a98-47e6-8f24-9be244058542", "address": "fa:16:3e:f3:16:90", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd870488-1a", "ovs_interfaceid": "fd870488-1a98-47e6-8f24-9be244058542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converting VIF {"id": "fd870488-1a98-47e6-8f24-9be244058542", "address": "fa:16:3e:f3:16:90", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd870488-1a", "ovs_interfaceid": "fd870488-1a98-47e6-8f24-9be244058542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:16:90,bridge_name='br-int',has_traffic_filtering=True,id=fd870488-1a98-47e6-8f24-9be244058542,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd870488-1a') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lazy-loading 'pci_devices' on Instance uuid 99116b0a-7426-4846-9a4b-dcf0bba5409f {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:59:31 user nova-compute[74889]:   <uuid>99116b0a-7426-4846-9a4b-dcf0bba5409f</uuid>
Nov 10 11:59:31 user nova-compute[74889]:   <name>instance-00000013</name>
Nov 10 11:59:31 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:59:31 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:59:31 user nova-compute[74889]:   <metadata>
Nov 10 11:59:31 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:59:31 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:59:31 user nova-compute[74889]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1205981455</nova:name>
Nov 10 11:59:31 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:59:31</nova:creationTime>
Nov 10 11:59:31 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:59:31 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:59:31 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:59:31 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:59:31 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:59:31 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:59:31 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:59:31 user nova-compute[74889]:       <nova:owner>
Nov 10 11:59:31 user nova-compute[74889]:         <nova:user uuid="d028f217bd5b4a3994139d537c623bc5">tempest-VolumesAdminNegativeTest-35604331-project-member</nova:user>
Nov 10 11:59:31 user nova-compute[74889]:         <nova:project uuid="74f4a33c330842ba9dca41b5a174a07d">tempest-VolumesAdminNegativeTest-35604331</nova:project>
Nov 10 11:59:31 user nova-compute[74889]:       </nova:owner>
Nov 10 11:59:31 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:59:31 user nova-compute[74889]:       <nova:ports>
Nov 10 11:59:31 user nova-compute[74889]:         <nova:port uuid="fd870488-1a98-47e6-8f24-9be244058542">
Nov 10 11:59:31 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 11:59:31 user nova-compute[74889]:         </nova:port>
Nov 10 11:59:31 user nova-compute[74889]:       </nova:ports>
Nov 10 11:59:31 user nova-compute[74889]:     </nova:instance>
Nov 10 11:59:31 user nova-compute[74889]:   </metadata>
Nov 10 11:59:31 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:59:31 user nova-compute[74889]:     <system>
Nov 10 11:59:31 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:59:31 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:59:31 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:59:31 user nova-compute[74889]:       <entry name="serial">99116b0a-7426-4846-9a4b-dcf0bba5409f</entry>
Nov 10 11:59:31 user nova-compute[74889]:       <entry name="uuid">99116b0a-7426-4846-9a4b-dcf0bba5409f</entry>
Nov 10 11:59:31 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:59:31 user nova-compute[74889]:     </system>
Nov 10 11:59:31 user nova-compute[74889]:   </sysinfo>
Nov 10 11:59:31 user nova-compute[74889]:   <os>
Nov 10 11:59:31 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:59:31 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:59:31 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:59:31 user nova-compute[74889]:   </os>
Nov 10 11:59:31 user nova-compute[74889]:   <features>
Nov 10 11:59:31 user nova-compute[74889]:     <acpi/>
Nov 10 11:59:31 user nova-compute[74889]:     <apic/>
Nov 10 11:59:31 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:59:31 user nova-compute[74889]:   </features>
Nov 10 11:59:31 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:59:31 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:59:31 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:59:31 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:59:31 user nova-compute[74889]:   </clock>
Nov 10 11:59:31 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:59:31 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:59:31 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:59:31 user nova-compute[74889]:   </cpu>
Nov 10 11:59:31 user nova-compute[74889]:   <devices>
Nov 10 11:59:31 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:59:31 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:59:31 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk"/>
Nov 10 11:59:31 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:59:31 user nova-compute[74889]:     </disk>
Nov 10 11:59:31 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:59:31 user nova-compute[74889]:       <mac address="fa:16:3e:f3:16:90"/>
Nov 10 11:59:31 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:59:31 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:59:31 user nova-compute[74889]:       <target dev="tapfd870488-1a"/>
Nov 10 11:59:31 user nova-compute[74889]:     </interface>
Nov 10 11:59:31 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:59:31 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/console.log" append="off"/>
Nov 10 11:59:31 user nova-compute[74889]:     </serial>
Nov 10 11:59:31 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:59:31 user nova-compute[74889]:     <video>
Nov 10 11:59:31 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:59:31 user nova-compute[74889]:     </video>
Nov 10 11:59:31 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:59:31 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:59:31 user nova-compute[74889]:     </rng>
Nov 10 11:59:31 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:59:31 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:59:31 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:59:31 user nova-compute[74889]:     </memballoon>
Nov 10 11:59:31 user nova-compute[74889]:   </devices>
Nov 10 11:59:31 user nova-compute[74889]: </domain>
Nov 10 11:59:31 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1205981455',display_name='tempest-VolumesAdminNegativeTest-server-1205981455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1205981455',id=19,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74f4a33c330842ba9dca41b5a174a07d',ramdisk_id='',reservation_id='r-ct11cshw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-35604331',owner_user_name='tempest-VolumesAdminNegativeTest-35604331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:59:30Z,user_data=None,user_id='d028f217bd5b4a3994139d537c623bc5',uuid=99116b0a-7426-4846-9a4b-dcf0bba5409f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd870488-1a98-47e6-8f24-9be244058542", "address": "fa:16:3e:f3:16:90", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd870488-1a", "ovs_interfaceid": "fd870488-1a98-47e6-8f24-9be244058542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converting VIF {"id": "fd870488-1a98-47e6-8f24-9be244058542", "address": "fa:16:3e:f3:16:90", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd870488-1a", "ovs_interfaceid": "fd870488-1a98-47e6-8f24-9be244058542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:16:90,bridge_name='br-int',has_traffic_filtering=True,id=fd870488-1a98-47e6-8f24-9be244058542,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd870488-1a') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG os_vif [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:16:90,bridge_name='br-int',has_traffic_filtering=True,id=fd870488-1a98-47e6-8f24-9be244058542,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd870488-1a') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dfc55d6-375d-5739-9d7a-10f1038286a9', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd870488-1a, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd870488-1a, col_values=(('qos', UUID('9bf7ee8f-cc29-41c6-8fd2-cf08ea093d03')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd870488-1a, col_values=(('external_ids', {'iface-id': 'fd870488-1a98-47e6-8f24-9be244058542', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:16:90', 'vm-uuid': '99116b0a-7426-4846-9a4b-dcf0bba5409f'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:31 user nova-compute[74889]: INFO os_vif [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:16:90,bridge_name='br-int',has_traffic_filtering=True,id=fd870488-1a98-47e6-8f24-9be244058542,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd870488-1a')
Nov 10 11:59:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:59:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] No VIF found with MAC fa:16:3e:f3:16:90, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:59:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-d0a9db50-3326-4ed3-8002-802093706a84 req-7c1457f7-9340-4ad0-8902-ba4a54fc82df service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Updated VIF entry in instance network info cache for port fd870488-1a98-47e6-8f24-9be244058542. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:59:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-d0a9db50-3326-4ed3-8002-802093706a84 req-7c1457f7-9340-4ad0-8902-ba4a54fc82df service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Updating instance_info_cache with network_info: [{"id": "fd870488-1a98-47e6-8f24-9be244058542", "address": "fa:16:3e:f3:16:90", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd870488-1a", "ovs_interfaceid": "fd870488-1a98-47e6-8f24-9be244058542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:59:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d0a9db50-3326-4ed3-8002-802093706a84 req-7c1457f7-9340-4ad0-8902-ba4a54fc82df service nova] Releasing lock "refresh_cache-99116b0a-7426-4846-9a4b-dcf0bba5409f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-eac2241f-b06b-4bfa-88eb-58ce90bb98b8 req-6f72c0a4-26b4-47d5-9e75-de32b67672c0 service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Received event network-vif-plugged-fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-eac2241f-b06b-4bfa-88eb-58ce90bb98b8 req-6f72c0a4-26b4-47d5-9e75-de32b67672c0 service nova] Acquiring lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-eac2241f-b06b-4bfa-88eb-58ce90bb98b8 req-6f72c0a4-26b4-47d5-9e75-de32b67672c0 service nova] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-eac2241f-b06b-4bfa-88eb-58ce90bb98b8 req-6f72c0a4-26b4-47d5-9e75-de32b67672c0 service nova] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-eac2241f-b06b-4bfa-88eb-58ce90bb98b8 req-6f72c0a4-26b4-47d5-9e75-de32b67672c0 service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] No waiting events found dispatching network-vif-plugged-fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:59:33 user nova-compute[74889]: WARNING nova.compute.manager [req-eac2241f-b06b-4bfa-88eb-58ce90bb98b8 req-6f72c0a4-26b4-47d5-9e75-de32b67672c0 service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Received unexpected event network-vif-plugged-fd870488-1a98-47e6-8f24-9be244058542 for instance with vm_state building and task_state spawning.
Nov 10 11:59:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:34 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:59:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:34 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:59:35 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Instance spawned successfully.
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:35 user nova-compute[74889]: INFO nova.compute.manager [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-24adf751-817b-48fe-9690-5551204aef33 req-98f2a7c4-1131-4843-8526-12470e93f689 service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Received event network-vif-plugged-fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-24adf751-817b-48fe-9690-5551204aef33 req-98f2a7c4-1131-4843-8526-12470e93f689 service nova] Acquiring lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-24adf751-817b-48fe-9690-5551204aef33 req-98f2a7c4-1131-4843-8526-12470e93f689 service nova] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-24adf751-817b-48fe-9690-5551204aef33 req-98f2a7c4-1131-4843-8526-12470e93f689 service nova] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-24adf751-817b-48fe-9690-5551204aef33 req-98f2a7c4-1131-4843-8526-12470e93f689 service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] No waiting events found dispatching network-vif-plugged-fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:59:35 user nova-compute[74889]: WARNING nova.compute.manager [req-24adf751-817b-48fe-9690-5551204aef33 req-98f2a7c4-1131-4843-8526-12470e93f689 service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Received unexpected event network-vif-plugged-fd870488-1a98-47e6-8f24-9be244058542 for instance with vm_state building and task_state spawning.
Nov 10 11:59:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:35 user nova-compute[74889]: INFO nova.compute.manager [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Took 6.37 seconds to build instance.
Nov 10 11:59:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7e428f96-57a1-4b9d-9eae-d0ea52bd0813 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.559s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquired lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'info_cache' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG nova.objects.base [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:59:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updating instance_info_cache with network_info: [{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Releasing lock "refresh_cache-527ef5ba-c67a-481a-b835-e8b6196f3902" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:59:39 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance destroyed successfully.
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'resources' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.objects.base [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-518100689',display_name='tempest-AttachVolumeTestJSON-server-518100689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-518100689',id=2,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEh76cZ/xflXBEdMOROgxqbhG35Jz0cqE4YYKJiGcf50O8aLCm2o2DfUHmGwzHJW0DU1jZ0rVUpQW2CmcsWOI30JbHZMThJB6IQjvv8CUUQ6Nrn1BLEBG5jDbyobMxuOg==',key_name='tempest-keypair-1235958409',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-ngy0se22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=527ef5ba-c67a-481a-b835-e8b6196f3902,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG os_vif [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b2c7fdc-3f, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13eb4932-dd01-444e-8794-ea7a386461ab) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:39 user nova-compute[74889]: INFO os_vif [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f')
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Start _get_guest_xml network_info=[{"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'numa_topology' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.objects.base [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:59:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'vcpu_model' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.objects.base [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-518100689',display_name='tempest-AttachVolumeTestJSON-server-518100689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-518100689',id=2,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEh76cZ/xflXBEdMOROgxqbhG35Jz0cqE4YYKJiGcf50O8aLCm2o2DfUHmGwzHJW0DU1jZ0rVUpQW2CmcsWOI30JbHZMThJB6IQjvv8CUUQ6Nrn1BLEBG5jDbyobMxuOg==',key_name='tempest-keypair-1235958409',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-ngy0se22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=527ef5ba-c67a-481a-b835-e8b6196f3902,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'pci_devices' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.objects.base [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:59:39 user nova-compute[74889]:   <uuid>527ef5ba-c67a-481a-b835-e8b6196f3902</uuid>
Nov 10 11:59:39 user nova-compute[74889]:   <name>instance-00000002</name>
Nov 10 11:59:39 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:59:39 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:59:39 user nova-compute[74889]:   <metadata>
Nov 10 11:59:39 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:59:39 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:59:39 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeTestJSON-server-518100689</nova:name>
Nov 10 11:59:39 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:59:39</nova:creationTime>
Nov 10 11:59:39 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:59:39 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:59:39 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:59:39 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:59:39 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:59:39 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:59:39 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:59:39 user nova-compute[74889]:       <nova:owner>
Nov 10 11:59:39 user nova-compute[74889]:         <nova:user uuid="9dd24986fbd2446dbb8f5fbc7edb1757">tempest-AttachVolumeTestJSON-1611590837-project-member</nova:user>
Nov 10 11:59:39 user nova-compute[74889]:         <nova:project uuid="eeabeb4c529647f296feb83801c04f34">tempest-AttachVolumeTestJSON-1611590837</nova:project>
Nov 10 11:59:39 user nova-compute[74889]:       </nova:owner>
Nov 10 11:59:39 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:59:39 user nova-compute[74889]:       <nova:ports>
Nov 10 11:59:39 user nova-compute[74889]:         <nova:port uuid="5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50">
Nov 10 11:59:39 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 11:59:39 user nova-compute[74889]:         </nova:port>
Nov 10 11:59:39 user nova-compute[74889]:       </nova:ports>
Nov 10 11:59:39 user nova-compute[74889]:     </nova:instance>
Nov 10 11:59:39 user nova-compute[74889]:   </metadata>
Nov 10 11:59:39 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:59:39 user nova-compute[74889]:     <system>
Nov 10 11:59:39 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:59:39 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:59:39 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:59:39 user nova-compute[74889]:       <entry name="serial">527ef5ba-c67a-481a-b835-e8b6196f3902</entry>
Nov 10 11:59:39 user nova-compute[74889]:       <entry name="uuid">527ef5ba-c67a-481a-b835-e8b6196f3902</entry>
Nov 10 11:59:39 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:59:39 user nova-compute[74889]:     </system>
Nov 10 11:59:39 user nova-compute[74889]:   </sysinfo>
Nov 10 11:59:39 user nova-compute[74889]:   <os>
Nov 10 11:59:39 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:59:39 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:59:39 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:59:39 user nova-compute[74889]:   </os>
Nov 10 11:59:39 user nova-compute[74889]:   <features>
Nov 10 11:59:39 user nova-compute[74889]:     <acpi/>
Nov 10 11:59:39 user nova-compute[74889]:     <apic/>
Nov 10 11:59:39 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:59:39 user nova-compute[74889]:   </features>
Nov 10 11:59:39 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:59:39 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:59:39 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:59:39 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:59:39 user nova-compute[74889]:   </clock>
Nov 10 11:59:39 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:59:39 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:59:39 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:59:39 user nova-compute[74889]:   </cpu>
Nov 10 11:59:39 user nova-compute[74889]:   <devices>
Nov 10 11:59:39 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:59:39 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:59:39 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk"/>
Nov 10 11:59:39 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:59:39 user nova-compute[74889]:     </disk>
Nov 10 11:59:39 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:59:39 user nova-compute[74889]:       <mac address="fa:16:3e:84:97:e7"/>
Nov 10 11:59:39 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:59:39 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:59:39 user nova-compute[74889]:       <target dev="tap5b2c7fdc-3f"/>
Nov 10 11:59:39 user nova-compute[74889]:     </interface>
Nov 10 11:59:39 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:59:39 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/console.log" append="off"/>
Nov 10 11:59:39 user nova-compute[74889]:     </serial>
Nov 10 11:59:39 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:59:39 user nova-compute[74889]:     <video>
Nov 10 11:59:39 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:59:39 user nova-compute[74889]:     </video>
Nov 10 11:59:39 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:59:39 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:59:39 user nova-compute[74889]:     </rng>
Nov 10 11:59:39 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:59:39 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:59:39 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:59:39 user nova-compute[74889]:     </memballoon>
Nov 10 11:59:39 user nova-compute[74889]:   </devices>
Nov 10 11:59:39 user nova-compute[74889]: </domain>
Nov 10 11:59:39 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG nova.objects.instance [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'trusted_certs' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG nova.objects.base [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-7417e24e-b75c-4a92-b760-5b9fd96574ef req-fb3683ad-c1f6-4dac-8ab2-3269ccffe68b service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-changed-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-7417e24e-b75c-4a92-b760-5b9fd96574ef req-fb3683ad-c1f6-4dac-8ab2-3269ccffe68b service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Refreshing instance network info cache due to event network-changed-37d0a738-3b02-4291-90e6-20f0a0215ab9. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7417e24e-b75c-4a92-b760-5b9fd96574ef req-fb3683ad-c1f6-4dac-8ab2-3269ccffe68b service nova] Acquiring lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7417e24e-b75c-4a92-b760-5b9fd96574ef req-fb3683ad-c1f6-4dac-8ab2-3269ccffe68b service nova] Acquired lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG nova.network.neutron [req-7417e24e-b75c-4a92-b760-5b9fd96574ef req-fb3683ad-c1f6-4dac-8ab2-3269ccffe68b service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Refreshing network info cache for port 37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.215s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.615s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Cannot resize image /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.objects.instance [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'migration_context' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:41 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:41 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7207MB free_disk=25.28908920288086GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.objects.base [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Object Instance<527ef5ba-c67a-481a-b835-e8b6196f3902> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-518100689',display_name='tempest-AttachVolumeTestJSON-server-518100689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-518100689',id=2,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEh76cZ/xflXBEdMOROgxqbhG35Jz0cqE4YYKJiGcf50O8aLCm2o2DfUHmGwzHJW0DU1jZ0rVUpQW2CmcsWOI30JbHZMThJB6IQjvv8CUUQ6Nrn1BLEBG5jDbyobMxuOg==',key_name='tempest-keypair-1235958409',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-ngy0se22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=527ef5ba-c67a-481a-b835-e8b6196f3902,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG os_vif [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e7ce74a7-78d6-5377-b2df-ef36d135d0bf', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b2c7fdc-3f, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b2c7fdc-3f, col_values=(('qos', UUID('a4be1a93-9714-4dd1-be62-de609d71b25f')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b2c7fdc-3f, col_values=(('external_ids', {'iface-id': '5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:97:e7', 'vm-uuid': '527ef5ba-c67a-481a-b835-e8b6196f3902'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:41 user nova-compute[74889]: INFO os_vif [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f')
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6200554d-5be6-48b4-90e9-4151006d8ce3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance ff790962-c708-465c-a240-36748871cfda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 81cfb431-3aee-4081-82ba-49612a294d61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 61077e59-6249-4a6e-b749-733ed9735bb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance fc53bac7-d79d-4c33-af61-340b00dd8758 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 93367290-6fa4-4bbe-b47b-2dfa27227bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 22718082-4c44-4384-8692-c216bb1a14e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 78fe06d2-9353-4b9a-8e34-2261f2f77fce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 99116b0a-7426-4846-9a4b-dcf0bba5409f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-7417e24e-b75c-4a92-b760-5b9fd96574ef req-fb3683ad-c1f6-4dac-8ab2-3269ccffe68b service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updated VIF entry in instance network info cache for port 37d0a738-3b02-4291-90e6-20f0a0215ab9. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-7417e24e-b75c-4a92-b760-5b9fd96574ef req-fb3683ad-c1f6-4dac-8ab2-3269ccffe68b service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updating instance_info_cache with network_info: [{"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7417e24e-b75c-4a92-b760-5b9fd96574ef req-fb3683ad-c1f6-4dac-8ab2-3269ccffe68b service nova] Releasing lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "e71c6401-13be-4906-9988-2687a67bb50f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "e71c6401-13be-4906-9988-2687a67bb50f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:41 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 11:59:41 user nova-compute[74889]: INFO nova.compute.claims [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Claim successful on node user
Nov 10 11:59:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 11:59:42 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-e10b3736-3d41-406c-9771-6170173e3c62 req-39ba1bc2-a9ce-4eeb-be8d-6dc80b03d234 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e10b3736-3d41-406c-9771-6170173e3c62 req-39ba1bc2-a9ce-4eeb-be8d-6dc80b03d234 service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e10b3736-3d41-406c-9771-6170173e3c62 req-39ba1bc2-a9ce-4eeb-be8d-6dc80b03d234 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e10b3736-3d41-406c-9771-6170173e3c62 req-39ba1bc2-a9ce-4eeb-be8d-6dc80b03d234 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-e10b3736-3d41-406c-9771-6170173e3c62 req-39ba1bc2-a9ce-4eeb-be8d-6dc80b03d234 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:59:42 user nova-compute[74889]: WARNING nova.compute.manager [req-e10b3736-3d41-406c-9771-6170173e3c62 req-39ba1bc2-a9ce-4eeb-be8d-6dc80b03d234 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state stopped and task_state powering-on.
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.policy [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0a2bf1ce37a4d05b3179b2e8573c3e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c664edf4b1844ed9592c9f5851b4bff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 11:59:42 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Creating image(s)
Nov 10 11:59:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "/opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "/opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "/opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.228s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.202s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk 1073741824" returned: 0 in 0.049s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-4f078720-e364-4cd4-89a5-339b72c68f3c req-f0c8ded7-0065-4599-839f-ec71bf5ca1c4 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-changed-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-4f078720-e364-4cd4-89a5-339b72c68f3c req-f0c8ded7-0065-4599-839f-ec71bf5ca1c4 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Refreshing instance network info cache due to event network-changed-37d0a738-3b02-4291-90e6-20f0a0215ab9. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4f078720-e364-4cd4-89a5-339b72c68f3c req-f0c8ded7-0065-4599-839f-ec71bf5ca1c4 service nova] Acquiring lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4f078720-e364-4cd4-89a5-339b72c68f3c req-f0c8ded7-0065-4599-839f-ec71bf5ca1c4 service nova] Acquired lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG nova.network.neutron [req-4f078720-e364-4cd4-89a5-339b72c68f3c req-f0c8ded7-0065-4599-839f-ec71bf5ca1c4 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Refreshing network info cache for port 37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Cannot resize image /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Ensure instance console log exists: /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Successfully created port: 11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:59:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: ff790962-c708-465c-a240-36748871cfda] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.network.neutron [req-4f078720-e364-4cd4-89a5-339b72c68f3c req-f0c8ded7-0065-4599-839f-ec71bf5ca1c4 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updated VIF entry in instance network info cache for port 37d0a738-3b02-4291-90e6-20f0a0215ab9. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.network.neutron [req-4f078720-e364-4cd4-89a5-339b72c68f3c req-f0c8ded7-0065-4599-839f-ec71bf5ca1c4 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updating instance_info_cache with network_info: [{"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4f078720-e364-4cd4-89a5-339b72c68f3c req-f0c8ded7-0065-4599-839f-ec71bf5ca1c4 service nova] Releasing lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: ff790962-c708-465c-a240-36748871cfda] Updating instance_info_cache with network_info: [{"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-ff790962-c708-465c-a240-36748871cfda" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: ff790962-c708-465c-a240-36748871cfda] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Successfully updated port: 11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "refresh_cache-e71c6401-13be-4906-9988-2687a67bb50f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquired lock "refresh_cache-e71c6401-13be-4906-9988-2687a67bb50f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "ff790962-c708-465c-a240-36748871cfda" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:44 user nova-compute[74889]: INFO nova.compute.manager [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Detaching volume b2f008cc-bb29-47ea-acbb-e97402d482b9
Nov 10 11:59:44 user nova-compute[74889]: INFO nova.virt.block_device [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Attempting to driver detach volume b2f008cc-bb29-47ea-acbb-e97402d482b9 from mountpoint /dev/vdb
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-a744b1b4-c8f3-483e-be55-7d1257ff45e2 req-7a44fc61-7b9d-4294-acf8-8d9759f6ffba service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a744b1b4-c8f3-483e-be55-7d1257ff45e2 req-7a44fc61-7b9d-4294-acf8-8d9759f6ffba service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a744b1b4-c8f3-483e-be55-7d1257ff45e2 req-7a44fc61-7b9d-4294-acf8-8d9759f6ffba service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a744b1b4-c8f3-483e-be55-7d1257ff45e2 req-7a44fc61-7b9d-4294-acf8-8d9759f6ffba service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-a744b1b4-c8f3-483e-be55-7d1257ff45e2 req-7a44fc61-7b9d-4294-acf8-8d9759f6ffba service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:59:44 user nova-compute[74889]: WARNING nova.compute.manager [req-a744b1b4-c8f3-483e-be55-7d1257ff45e2 req-7a44fc61-7b9d-4294-acf8-8d9759f6ffba service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state stopped and task_state powering-on.
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:59:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance rebooted successfully.
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-14143898-5d04-4e7a-934c-e4c79fd51b2e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Attempting to detach device vdb from instance ff790962-c708-465c-a240-36748871cfda from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:59:44 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:59:44 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:59:44 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:59:44 user nova-compute[74889]:   <serial>b2f008cc-bb29-47ea-acbb-e97402d482b9</serial>
Nov 10 11:59:44 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 11:59:44 user nova-compute[74889]: </disk>
Nov 10 11:59:44 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:59:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully detached device vdb from instance ff790962-c708-465c-a240-36748871cfda from the persistent domain config.
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ff790962-c708-465c-a240-36748871cfda from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 11:59:44 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 11:59:44 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 11:59:44 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 11:59:44 user nova-compute[74889]:   <serial>b2f008cc-bb29-47ea-acbb-e97402d482b9</serial>
Nov 10 11:59:44 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 11:59:44 user nova-compute[74889]: </disk>
Nov 10 11:59:44 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Updating instance_info_cache with network_info: [{"id": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "address": "fa:16:3e:3c:e2:ef", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11faf425-cf", "ovs_interfaceid": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Releasing lock "refresh_cache-e71c6401-13be-4906-9988-2687a67bb50f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Instance network_info: |[{"id": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "address": "fa:16:3e:3c:e2:ef", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11faf425-cf", "ovs_interfaceid": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Start _get_guest_xml network_info=[{"id": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "address": "fa:16:3e:3c:e2:ef", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11faf425-cf", "ovs_interfaceid": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:59:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:59:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1661965481',display_name='tempest-VolumesActionsTest-instance-1661965481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1661965481',id=20,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c664edf4b1844ed9592c9f5851b4bff',ramdisk_id='',reservation_id='r-0yfyd1yf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1744369685',owner_user_name='tempest-VolumesActionsTest-1744369685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:59:43Z,user_data=None,user_id='c0a2bf1ce37a4d05b3179b2e8573c3e1',uuid=e71c6401-13be-4906-9988-2687a67bb50f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "address": "fa:16:3e:3c:e2:ef", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11faf425-cf", "ovs_interfaceid": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converting VIF {"id": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "address": "fa:16:3e:3c:e2:ef", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11faf425-cf", "ovs_interfaceid": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=11faf425-cfdf-49de-b1f2-611d2d7d7778,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11faf425-cf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.objects.instance [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lazy-loading 'pci_devices' on Instance uuid e71c6401-13be-4906-9988-2687a67bb50f {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 11:59:45 user nova-compute[74889]:   <uuid>e71c6401-13be-4906-9988-2687a67bb50f</uuid>
Nov 10 11:59:45 user nova-compute[74889]:   <name>instance-00000014</name>
Nov 10 11:59:45 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 11:59:45 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 11:59:45 user nova-compute[74889]:   <metadata>
Nov 10 11:59:45 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 11:59:45 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 11:59:45 user nova-compute[74889]:       <nova:name>tempest-VolumesActionsTest-instance-1661965481</nova:name>
Nov 10 11:59:45 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:59:44</nova:creationTime>
Nov 10 11:59:45 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 11:59:45 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 11:59:45 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 11:59:45 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 11:59:45 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 11:59:45 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 11:59:45 user nova-compute[74889]:       </nova:flavor>
Nov 10 11:59:45 user nova-compute[74889]:       <nova:owner>
Nov 10 11:59:45 user nova-compute[74889]:         <nova:user uuid="c0a2bf1ce37a4d05b3179b2e8573c3e1">tempest-VolumesActionsTest-1744369685-project-member</nova:user>
Nov 10 11:59:45 user nova-compute[74889]:         <nova:project uuid="6c664edf4b1844ed9592c9f5851b4bff">tempest-VolumesActionsTest-1744369685</nova:project>
Nov 10 11:59:45 user nova-compute[74889]:       </nova:owner>
Nov 10 11:59:45 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 11:59:45 user nova-compute[74889]:       <nova:ports>
Nov 10 11:59:45 user nova-compute[74889]:         <nova:port uuid="11faf425-cfdf-49de-b1f2-611d2d7d7778">
Nov 10 11:59:45 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 11:59:45 user nova-compute[74889]:         </nova:port>
Nov 10 11:59:45 user nova-compute[74889]:       </nova:ports>
Nov 10 11:59:45 user nova-compute[74889]:     </nova:instance>
Nov 10 11:59:45 user nova-compute[74889]:   </metadata>
Nov 10 11:59:45 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 11:59:45 user nova-compute[74889]:     <system>
Nov 10 11:59:45 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 11:59:45 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 11:59:45 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 11:59:45 user nova-compute[74889]:       <entry name="serial">e71c6401-13be-4906-9988-2687a67bb50f</entry>
Nov 10 11:59:45 user nova-compute[74889]:       <entry name="uuid">e71c6401-13be-4906-9988-2687a67bb50f</entry>
Nov 10 11:59:45 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 11:59:45 user nova-compute[74889]:     </system>
Nov 10 11:59:45 user nova-compute[74889]:   </sysinfo>
Nov 10 11:59:45 user nova-compute[74889]:   <os>
Nov 10 11:59:45 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 11:59:45 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 11:59:45 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 11:59:45 user nova-compute[74889]:   </os>
Nov 10 11:59:45 user nova-compute[74889]:   <features>
Nov 10 11:59:45 user nova-compute[74889]:     <acpi/>
Nov 10 11:59:45 user nova-compute[74889]:     <apic/>
Nov 10 11:59:45 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 11:59:45 user nova-compute[74889]:   </features>
Nov 10 11:59:45 user nova-compute[74889]:   <clock offset="utc">
Nov 10 11:59:45 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 11:59:45 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 11:59:45 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 11:59:45 user nova-compute[74889]:   </clock>
Nov 10 11:59:45 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 11:59:45 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 11:59:45 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 11:59:45 user nova-compute[74889]:   </cpu>
Nov 10 11:59:45 user nova-compute[74889]:   <devices>
Nov 10 11:59:45 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 11:59:45 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 11:59:45 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk"/>
Nov 10 11:59:45 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 11:59:45 user nova-compute[74889]:     </disk>
Nov 10 11:59:45 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 11:59:45 user nova-compute[74889]:       <mac address="fa:16:3e:3c:e2:ef"/>
Nov 10 11:59:45 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:59:45 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 11:59:45 user nova-compute[74889]:       <target dev="tap11faf425-cf"/>
Nov 10 11:59:45 user nova-compute[74889]:     </interface>
Nov 10 11:59:45 user nova-compute[74889]:     <serial type="pty">
Nov 10 11:59:45 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/console.log" append="off"/>
Nov 10 11:59:45 user nova-compute[74889]:     </serial>
Nov 10 11:59:45 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 11:59:45 user nova-compute[74889]:     <video>
Nov 10 11:59:45 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 11:59:45 user nova-compute[74889]:     </video>
Nov 10 11:59:45 user nova-compute[74889]:     <rng model="virtio">
Nov 10 11:59:45 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 11:59:45 user nova-compute[74889]:     </rng>
Nov 10 11:59:45 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 11:59:45 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 11:59:45 user nova-compute[74889]:       <stats period="10"/>
Nov 10 11:59:45 user nova-compute[74889]:     </memballoon>
Nov 10 11:59:45 user nova-compute[74889]:   </devices>
Nov 10 11:59:45 user nova-compute[74889]: </domain>
Nov 10 11:59:45 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1661965481',display_name='tempest-VolumesActionsTest-instance-1661965481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1661965481',id=20,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c664edf4b1844ed9592c9f5851b4bff',ramdisk_id='',reservation_id='r-0yfyd1yf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1744369685',owner_user_name='tempest-VolumesActionsTest-1744369685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:59:43Z,user_data=None,user_id='c0a2bf1ce37a4d05b3179b2e8573c3e1',uuid=e71c6401-13be-4906-9988-2687a67bb50f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "address": "fa:16:3e:3c:e2:ef", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11faf425-cf", "ovs_interfaceid": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converting VIF {"id": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "address": "fa:16:3e:3c:e2:ef", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11faf425-cf", "ovs_interfaceid": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=11faf425-cfdf-49de-b1f2-611d2d7d7778,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11faf425-cf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG os_vif [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=11faf425-cfdf-49de-b1f2-611d2d7d7778,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11faf425-cf') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bad353eb-abea-502e-8380-a872dfcde4f1', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11faf425-cf, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11faf425-cf, col_values=(('qos', UUID('e7e99c8d-3d94-4cba-a7da-4dc400b183f9')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11faf425-cf, col_values=(('external_ids', {'iface-id': '11faf425-cfdf-49de-b1f2-611d2d7d7778', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:e2:ef', 'vm-uuid': 'e71c6401-13be-4906-9988-2687a67bb50f'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:45 user nova-compute[74889]: INFO os_vif [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=11faf425-cfdf-49de-b1f2-611d2d7d7778,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11faf425-cf')
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] No VIF found with MAC fa:16:3e:3c:e2:ef, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ff790962-c708-465c-a240-36748871cfda {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-cb5030bc-e80c-4232-bd28-7b47984b9d29 req-a97f62c8-4fc1-4b35-9e78-43f9605d5f9d service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Received event network-changed-11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-cb5030bc-e80c-4232-bd28-7b47984b9d29 req-a97f62c8-4fc1-4b35-9e78-43f9605d5f9d service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Refreshing instance network info cache due to event network-changed-11faf425-cfdf-49de-b1f2-611d2d7d7778. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb5030bc-e80c-4232-bd28-7b47984b9d29 req-a97f62c8-4fc1-4b35-9e78-43f9605d5f9d service nova] Acquiring lock "refresh_cache-e71c6401-13be-4906-9988-2687a67bb50f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb5030bc-e80c-4232-bd28-7b47984b9d29 req-a97f62c8-4fc1-4b35-9e78-43f9605d5f9d service nova] Acquired lock "refresh_cache-e71c6401-13be-4906-9988-2687a67bb50f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:59:45 user nova-compute[74889]: DEBUG nova.network.neutron [req-cb5030bc-e80c-4232-bd28-7b47984b9d29 req-a97f62c8-4fc1-4b35-9e78-43f9605d5f9d service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Refreshing network info cache for port 11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-cb5030bc-e80c-4232-bd28-7b47984b9d29 req-a97f62c8-4fc1-4b35-9e78-43f9605d5f9d service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Updated VIF entry in instance network info cache for port 11faf425-cfdf-49de-b1f2-611d2d7d7778. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-cb5030bc-e80c-4232-bd28-7b47984b9d29 req-a97f62c8-4fc1-4b35-9e78-43f9605d5f9d service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Updating instance_info_cache with network_info: [{"id": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "address": "fa:16:3e:3c:e2:ef", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11faf425-cf", "ovs_interfaceid": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb5030bc-e80c-4232-bd28-7b47984b9d29 req-a97f62c8-4fc1-4b35-9e78-43f9605d5f9d service nova] Releasing lock "refresh_cache-e71c6401-13be-4906-9988-2687a67bb50f" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-a78c9aed-2f62-4e7a-9c5b-1eccc549ae7e req-cdba58a9-28d0-4965-b41e-dd82e35ae8c0 service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Received event network-vif-plugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a78c9aed-2f62-4e7a-9c5b-1eccc549ae7e req-cdba58a9-28d0-4965-b41e-dd82e35ae8c0 service nova] Acquiring lock "e71c6401-13be-4906-9988-2687a67bb50f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a78c9aed-2f62-4e7a-9c5b-1eccc549ae7e req-cdba58a9-28d0-4965-b41e-dd82e35ae8c0 service nova] Lock "e71c6401-13be-4906-9988-2687a67bb50f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a78c9aed-2f62-4e7a-9c5b-1eccc549ae7e req-cdba58a9-28d0-4965-b41e-dd82e35ae8c0 service nova] Lock "e71c6401-13be-4906-9988-2687a67bb50f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-a78c9aed-2f62-4e7a-9c5b-1eccc549ae7e req-cdba58a9-28d0-4965-b41e-dd82e35ae8c0 service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] No waiting events found dispatching network-vif-plugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:59:46 user nova-compute[74889]: WARNING nova.compute.manager [req-a78c9aed-2f62-4e7a-9c5b-1eccc549ae7e req-cdba58a9-28d0-4965-b41e-dd82e35ae8c0 service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Received unexpected event network-vif-plugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 for instance with vm_state building and task_state spawning.
Nov 10 11:59:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-1497cdc1-ba86-4b9f-b35c-5ec16a1cfe8c req-435ef928-b37a-45ea-90f6-a9102cd91adf service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received event network-changed-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-1497cdc1-ba86-4b9f-b35c-5ec16a1cfe8c req-435ef928-b37a-45ea-90f6-a9102cd91adf service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Refreshing instance network info cache due to event network-changed-64d5dc91-1a08-49c0-919e-d12b925316be. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 11:59:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1497cdc1-ba86-4b9f-b35c-5ec16a1cfe8c req-435ef928-b37a-45ea-90f6-a9102cd91adf service nova] Acquiring lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:59:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1497cdc1-ba86-4b9f-b35c-5ec16a1cfe8c req-435ef928-b37a-45ea-90f6-a9102cd91adf service nova] Acquired lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:59:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-1497cdc1-ba86-4b9f-b35c-5ec16a1cfe8c req-435ef928-b37a-45ea-90f6-a9102cd91adf service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Refreshing network info cache for port 64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "fc53bac7-d79d-4c33-af61-340b00dd8758" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lazy-loading 'flavor' on Instance uuid fc53bac7-d79d-4c33-af61-340b00dd8758 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "fc53bac7-d79d-4c33-af61-340b00dd8758" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:48 user nova-compute[74889]: INFO nova.compute.manager [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Attaching volume ae623441-bac2-4028-834b-79263c2f0117 to /dev/vdb
Nov 10 11:59:48 user nova-compute[74889]: DEBUG os_brick.utils [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a5e71-a45a-462b-a258-b919950acf20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[563d424c-0985-4897-ae53-5800650e6121]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[508c60d9-478d-4f80-bb49-e36e8c0a3662]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46ea479-566c-44e4-8a1d-d57c13952009]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 11:59:48 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24791cf-57e1-40e3-b55c-7460bcba283f]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG os_brick.utils [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Updating existing volume attachment record: a855160e-a292-46b0-98a3-83c570a6a23b {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG nova.network.neutron [req-1497cdc1-ba86-4b9f-b35c-5ec16a1cfe8c req-435ef928-b37a-45ea-90f6-a9102cd91adf service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Updated VIF entry in instance network info cache for port 64d5dc91-1a08-49c0-919e-d12b925316be. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG nova.network.neutron [req-1497cdc1-ba86-4b9f-b35c-5ec16a1cfe8c req-435ef928-b37a-45ea-90f6-a9102cd91adf service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Updating instance_info_cache with network_info: [{"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1497cdc1-ba86-4b9f-b35c-5ec16a1cfe8c req-435ef928-b37a-45ea-90f6-a9102cd91adf service nova] Releasing lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-3a9a9a9a-a737-4b09-9f20-59f7b3ef8126 req-69f86141-0c2f-4094-b386-349e7e38f2d3 service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Received event network-vif-plugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3a9a9a9a-a737-4b09-9f20-59f7b3ef8126 req-69f86141-0c2f-4094-b386-349e7e38f2d3 service nova] Acquiring lock "e71c6401-13be-4906-9988-2687a67bb50f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3a9a9a9a-a737-4b09-9f20-59f7b3ef8126 req-69f86141-0c2f-4094-b386-349e7e38f2d3 service nova] Lock "e71c6401-13be-4906-9988-2687a67bb50f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3a9a9a9a-a737-4b09-9f20-59f7b3ef8126 req-69f86141-0c2f-4094-b386-349e7e38f2d3 service nova] Lock "e71c6401-13be-4906-9988-2687a67bb50f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-3a9a9a9a-a737-4b09-9f20-59f7b3ef8126 req-69f86141-0c2f-4094-b386-349e7e38f2d3 service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] No waiting events found dispatching network-vif-plugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:59:48 user nova-compute[74889]: WARNING nova.compute.manager [req-3a9a9a9a-a737-4b09-9f20-59f7b3ef8126 req-69f86141-0c2f-4094-b386-349e7e38f2d3 service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Received unexpected event network-vif-plugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 for instance with vm_state building and task_state spawning.
Nov 10 11:59:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 11:59:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 11:59:48 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Instance spawned successfully.
Nov 10 11:59:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 11:59:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 11:59:49 user nova-compute[74889]: INFO nova.compute.manager [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 10 11:59:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:59:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:49 user nova-compute[74889]: INFO nova.compute.manager [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Took 7.35 seconds to build instance.
Nov 10 11:59:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd0731e7-a033-45f5-ae0e-aeffef641dcf tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "e71c6401-13be-4906-9988-2687a67bb50f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.448s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:57 user nova-compute[74889]: INFO nova.compute.manager [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Rebooting instance
Nov 10 11:59:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 11:59:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquired lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 11:59:57 user nova-compute[74889]: DEBUG nova.network.neutron [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG nova.network.neutron [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updating instance_info_cache with network_info: [{"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Releasing lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-95dbaa53-87ba-494b-94fa-dfebfcb32800 req-b50af518-82e0-4627-924f-a646ae1c2630 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-vif-unplugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-95dbaa53-87ba-494b-94fa-dfebfcb32800 req-b50af518-82e0-4627-924f-a646ae1c2630 service nova] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-95dbaa53-87ba-494b-94fa-dfebfcb32800 req-b50af518-82e0-4627-924f-a646ae1c2630 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-95dbaa53-87ba-494b-94fa-dfebfcb32800 req-b50af518-82e0-4627-924f-a646ae1c2630 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-95dbaa53-87ba-494b-94fa-dfebfcb32800 req-b50af518-82e0-4627-924f-a646ae1c2630 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] No waiting events found dispatching network-vif-unplugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 11:59:58 user nova-compute[74889]: WARNING nova.compute.manager [req-95dbaa53-87ba-494b-94fa-dfebfcb32800 req-b50af518-82e0-4627-924f-a646ae1c2630 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received unexpected event network-vif-unplugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 11:59:58 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Instance destroyed successfully.
Nov 10 11:59:58 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'resources' on Instance uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1245126454',display_name='tempest-TestMinimumBasicScenario-server-1245126454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1245126454',id=13,image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7GZ41ZWNzFvBcWtC9GTpFVqgVYTBFqi084aaLambFMQNgXoeTPHI9MF8shzD+xmyYsSreQCj75/9GnV0q5V1LN3QXUdTI2poyQnKSwe5JoSZ5kbu3SuKCJK8NqZeSD3A==',key_name='tempest-TestMinimumBasicScenario-482704221',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:57:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1298008035034b9ea352dc01af38a417',ramdisk_id='',reservation_id='r-0vx1c0zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1750479142',owner_user_name='tempest-TestMinimumBasicScenario-1750479142-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:59:58Z,user_data=None,user_id='f59a12b24b02408e9602dd7146453a57',uuid=51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converting VIF {"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG os_vif [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37d0a738-3b, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7096040-3a8e-43ab-9b10-4bc3e0fa6dd0) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:58 user nova-compute[74889]: INFO os_vif [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b')
Nov 10 11:59:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRLpXniC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:59:58 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:59:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:59:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d9f51-3678-4a68-ba92-22fa63557ea4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 11:59:59 user nova-compute[74889]: No targets found.
Nov 10 11:59:59 user nova-compute[74889]: iSNS:
Nov 10 11:59:59 user nova-compute[74889]: No targets found.
Nov 10 11:59:59 user nova-compute[74889]: STATIC:
Nov 10 11:59:59 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9
Nov 10 11:59:59 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:59:59 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:59:59 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584
Nov 10 11:59:59 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:59:59 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:59:59 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a
Nov 10 11:59:59 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:59:59 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:59:59 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad
Nov 10 11:59:59 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 11:59:59 user nova-compute[74889]:                 Iface Name: default
Nov 10 11:59:59 user nova-compute[74889]: FIRMWARE:
Nov 10 11:59:59 user nova-compute[74889]: No targets found.
Nov 10 11:59:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 11:59:59 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 11:59:59 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c27b14e-1285-4f0c-8e4f-010a57179d80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7071861c-1941-4e1b-a301-d925e80eafe8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 11:59:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 11:59:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a03d5e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad'): ({'sdc'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Removing single pathed devices sdc {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[447fd6d6-a0eb-47d2-b231-147b3f22fc28]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f7ff0f-a201-41af-aa4c-628fc19a439c]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Flushing IO for device /dev/sdc {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56078cf-acfe-423d-9af6-89b11bd734f0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f7b3e2-f046-4568-bac6-79b048ad204d]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6929ce59-c7df-47d1-b1eb-bd2e2fb2c1f0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfbbc9c-7b61-43d0-8f14-d72ddb5d2090]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260]
Nov 10 11:59:59 user nova-compute[74889]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260] successful.
Nov 10 11:59:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb1b978-3fd3-4eb3-b511-6f27b5d4fa7c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] <== disconnect_volume: return (344ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Start _get_guest_xml network_info=[{"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=67949d31-8d59-4baf-9c85-11bad7396a97,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': '67949d31-8d59-4baf-9c85-11bad7396a97'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRLpXniC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b', 'attached_at': '', 'detached_at': '', 'volume_id': '4eb06668-3486-48c6-9f64-1df49ce73aad', 'serial': '4eb06668-3486-48c6-9f64-1df49ce73aad'}, 'disk_bus': 'virtio', 'attachment_id': 'a4a0bff4-7be7-4191-83ab-080ad7b30f11', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 11:59:59 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:59 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=67949d31-8d59-4baf-9c85-11bad7396a97,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.objects.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Object Instance<51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b> lazy-loaded attributes: resources,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRLpXniC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 11:59:59 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:59:59 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 11:59:59 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0108b19-f43c-46bb-b52b-757b289d3fb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 11:59:59 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c03a7e8-f648-48c1-800e-59e493fa41c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad] added
Nov 10 11:59:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3914ef-0ed4-48a1-811f-86928dbd019a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda66f10-7cb9-47a8-a8fd-e95d30259157]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRLpXniC {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRLpXniC" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc34eb0-311d-44c6-9dd5-d7a66e0beeba]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wRLpXniC'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ae7538-759b-41c9-88a9-7ad5ef996a75]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb844b69-9a14-46cf-9962-3acc2f641b57]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8289eae-3898-4e56-9dd3-c220f13c27c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260]
Nov 10 11:59:59 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260] successful.
Nov 10 11:59:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a124e09b-8759-453d-96aa-b789a4a0bb86]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3239dfd-7a1c-41a5-a735-f023ef5c6931]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 11:59:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 11:59:59 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 11:59:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1640abfc-3ac7-46c6-a3a8-ff5a0536625f]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 11:59:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRLpXniC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-53ec4ad2-b9c7-4e46-808f-4548ba6cfbe4 req-761520a6-5898-4775-bb80-d5f291fd9b97 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-53ec4ad2-b9c7-4e46-808f-4548ba6cfbe4 req-761520a6-5898-4775-bb80-d5f291fd9b97 service nova] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-53ec4ad2-b9c7-4e46-808f-4548ba6cfbe4 req-761520a6-5898-4775-bb80-d5f291fd9b97 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-53ec4ad2-b9c7-4e46-808f-4548ba6cfbe4 req-761520a6-5898-4775-bb80-d5f291fd9b97 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-53ec4ad2-b9c7-4e46-808f-4548ba6cfbe4 req-761520a6-5898-4775-bb80-d5f291fd9b97 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] No waiting events found dispatching network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:00 user nova-compute[74889]: WARNING nova.compute.manager [req-53ec4ad2-b9c7-4e46-808f-4548ba6cfbe4 req-761520a6-5898-4775-bb80-d5f291fd9b97 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received unexpected event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 12:00:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23439653134313836', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439653134313836', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1245126454',display_name='tempest-TestMinimumBasicScenario-server-1245126454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1245126454',id=13,image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7GZ41ZWNzFvBcWtC9GTpFVqgVYTBFqi084aaLambFMQNgXoeTPHI9MF8shzD+xmyYsSreQCj75/9GnV0q5V1LN3QXUdTI2poyQnKSwe5JoSZ5kbu3SuKCJK8NqZeSD3A==',key_name='tempest-TestMinimumBasicScenario-482704221',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:57:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1298008035034b9ea352dc01af38a417',ramdisk_id='',reservation_id='r-0vx1c0zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1750479142',owner_user_name='tempest-TestMinimumBasicScenario-1750479142-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:59:58Z,user_data=None,user_id='f59a12b24b02408e9602dd7146453a57',uuid=51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converting VIF {"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'pci_devices' on Instance uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG nova.objects.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Object Instance<51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:00:00 user nova-compute[74889]:   <uuid>51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b</uuid>
Nov 10 12:00:00 user nova-compute[74889]:   <name>instance-0000000d</name>
Nov 10 12:00:00 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:00:00 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:00:00 user nova-compute[74889]:   <metadata>
Nov 10 12:00:00 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:00:00 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:00:00 user nova-compute[74889]:       <nova:name>tempest-TestMinimumBasicScenario-server-1245126454</nova:name>
Nov 10 12:00:00 user nova-compute[74889]:       <nova:creationTime>2023-11-10 11:59:59</nova:creationTime>
Nov 10 12:00:00 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:00:00 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:00:00 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:00:00 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:00:00 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:00:00 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:00:00 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:00:00 user nova-compute[74889]:       <nova:owner>
Nov 10 12:00:00 user nova-compute[74889]:         <nova:user uuid="f59a12b24b02408e9602dd7146453a57">tempest-TestMinimumBasicScenario-1750479142-project-member</nova:user>
Nov 10 12:00:00 user nova-compute[74889]:         <nova:project uuid="1298008035034b9ea352dc01af38a417">tempest-TestMinimumBasicScenario-1750479142</nova:project>
Nov 10 12:00:00 user nova-compute[74889]:       </nova:owner>
Nov 10 12:00:00 user nova-compute[74889]:       <nova:root type="image" uuid="67949d31-8d59-4baf-9c85-11bad7396a97"/>
Nov 10 12:00:00 user nova-compute[74889]:       <nova:ports>
Nov 10 12:00:00 user nova-compute[74889]:         <nova:port uuid="37d0a738-3b02-4291-90e6-20f0a0215ab9">
Nov 10 12:00:00 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 12:00:00 user nova-compute[74889]:         </nova:port>
Nov 10 12:00:00 user nova-compute[74889]:       </nova:ports>
Nov 10 12:00:00 user nova-compute[74889]:     </nova:instance>
Nov 10 12:00:00 user nova-compute[74889]:   </metadata>
Nov 10 12:00:00 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:00:00 user nova-compute[74889]:     <system>
Nov 10 12:00:00 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:00:00 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:00:00 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:00:00 user nova-compute[74889]:       <entry name="serial">51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b</entry>
Nov 10 12:00:00 user nova-compute[74889]:       <entry name="uuid">51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b</entry>
Nov 10 12:00:00 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:00:00 user nova-compute[74889]:     </system>
Nov 10 12:00:00 user nova-compute[74889]:   </sysinfo>
Nov 10 12:00:00 user nova-compute[74889]:   <os>
Nov 10 12:00:00 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:00:00 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:00:00 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:00:00 user nova-compute[74889]:   </os>
Nov 10 12:00:00 user nova-compute[74889]:   <features>
Nov 10 12:00:00 user nova-compute[74889]:     <acpi/>
Nov 10 12:00:00 user nova-compute[74889]:     <apic/>
Nov 10 12:00:00 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:00:00 user nova-compute[74889]:   </features>
Nov 10 12:00:00 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:00:00 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:00:00 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:00:00 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:00:00 user nova-compute[74889]:   </clock>
Nov 10 12:00:00 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:00:00 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:00:00 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:00:00 user nova-compute[74889]:   </cpu>
Nov 10 12:00:00 user nova-compute[74889]:   <devices>
Nov 10 12:00:00 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:00:00 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:00:00 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk"/>
Nov 10 12:00:00 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:00:00 user nova-compute[74889]:     </disk>
Nov 10 12:00:00 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:00:00 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:00:00 user nova-compute[74889]:       <source dev="/dev/sdc"/>
Nov 10 12:00:00 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 12:00:00 user nova-compute[74889]:       <serial>4eb06668-3486-48c6-9f64-1df49ce73aad</serial>
Nov 10 12:00:00 user nova-compute[74889]:     </disk>
Nov 10 12:00:00 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:00:00 user nova-compute[74889]:       <mac address="fa:16:3e:fe:b2:5b"/>
Nov 10 12:00:00 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:00:00 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:00:00 user nova-compute[74889]:       <target dev="tap37d0a738-3b"/>
Nov 10 12:00:00 user nova-compute[74889]:     </interface>
Nov 10 12:00:00 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:00:00 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/console.log" append="off"/>
Nov 10 12:00:00 user nova-compute[74889]:     </serial>
Nov 10 12:00:00 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:00:00 user nova-compute[74889]:     <video>
Nov 10 12:00:00 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:00:00 user nova-compute[74889]:     </video>
Nov 10 12:00:00 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:00:00 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:00:00 user nova-compute[74889]:     </rng>
Nov 10 12:00:00 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:00:00 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:00:00 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:00:00 user nova-compute[74889]:     </memballoon>
Nov 10 12:00:00 user nova-compute[74889]:   </devices>
Nov 10 12:00:00 user nova-compute[74889]: </domain>
Nov 10 12:00:00 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'trusted_certs' on Instance uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG nova.objects.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Object Instance<51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06 --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Cannot resize image /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'migration_context' on Instance uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG nova.objects.base [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Object Instance<51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1245126454',display_name='tempest-TestMinimumBasicScenario-server-1245126454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1245126454',id=13,image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7GZ41ZWNzFvBcWtC9GTpFVqgVYTBFqi084aaLambFMQNgXoeTPHI9MF8shzD+xmyYsSreQCj75/9GnV0q5V1LN3QXUdTI2poyQnKSwe5JoSZ5kbu3SuKCJK8NqZeSD3A==',key_name='tempest-TestMinimumBasicScenario-482704221',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:57:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1298008035034b9ea352dc01af38a417',ramdisk_id='',reservation_id='r-0vx1c0zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1750479142',owner_user_name='tempest-TestMinimumBasicScenario-1750479142-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T11:59:58Z,user_data=None,user_id='f59a12b24b02408e9602dd7146453a57',uuid=51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converting VIF {"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG os_vif [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8eaa11fd-9034-5ebf-ab64-d095fda00eaf', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37d0a738-3b, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37d0a738-3b, col_values=(('qos', UUID('6753e733-1e4f-45ac-9b9b-81188d734719')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37d0a738-3b, col_values=(('external_ids', {'iface-id': '37d0a738-3b02-4291-90e6-20f0a0215ab9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:b2:5b', 'vm-uuid': '51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:00:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:01 user nova-compute[74889]: INFO os_vif [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b')
Nov 10 12:00:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-75e551bd-60f7-4115-8ab6-2d6f6b7769b4 req-c3d0a175-b55f-474b-a8f6-056c9a7688fa service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-75e551bd-60f7-4115-8ab6-2d6f6b7769b4 req-c3d0a175-b55f-474b-a8f6-056c9a7688fa service nova] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-75e551bd-60f7-4115-8ab6-2d6f6b7769b4 req-c3d0a175-b55f-474b-a8f6-056c9a7688fa service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-75e551bd-60f7-4115-8ab6-2d6f6b7769b4 req-c3d0a175-b55f-474b-a8f6-056c9a7688fa service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-75e551bd-60f7-4115-8ab6-2d6f6b7769b4 req-c3d0a175-b55f-474b-a8f6-056c9a7688fa service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] No waiting events found dispatching network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:03 user nova-compute[74889]: WARNING nova.compute.manager [req-75e551bd-60f7-4115-8ab6-2d6f6b7769b4 req-c3d0a175-b55f-474b-a8f6-056c9a7688fa service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received unexpected event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 12:00:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:05 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ff790962-c708-465c-a240-36748871cfda is timed out.
Nov 10 12:00:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully detached device vdb from instance ff790962-c708-465c-a240-36748871cfda from the live domain config.
Nov 10 12:00:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJLxoOMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:00:05 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e111513-f44d-4fb5-a497-7cceeb38b28a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:00:05 user nova-compute[74889]: No targets found.
Nov 10 12:00:05 user nova-compute[74889]: iSNS:
Nov 10 12:00:05 user nova-compute[74889]: No targets found.
Nov 10 12:00:05 user nova-compute[74889]: STATIC:
Nov 10 12:00:05 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9
Nov 10 12:00:05 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:05 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:05 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584
Nov 10 12:00:05 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:05 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:05 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a
Nov 10 12:00:05 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:05 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:05 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad
Nov 10 12:00:05 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:05 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:05 user nova-compute[74889]: FIRMWARE:
Nov 10 12:00:05 user nova-compute[74889]: No targets found.
Nov 10 12:00:05 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:00:05 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:00:05 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-6cab3da8-3ea6-441b-bcd8-d4c852eab0a2 req-1eef5fcf-2201-45c3-b2eb-e710755d8b5e service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6cab3da8-3ea6-441b-bcd8-d4c852eab0a2 req-1eef5fcf-2201-45c3-b2eb-e710755d8b5e service nova] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6cab3da8-3ea6-441b-bcd8-d4c852eab0a2 req-1eef5fcf-2201-45c3-b2eb-e710755d8b5e service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6cab3da8-3ea6-441b-bcd8-d4c852eab0a2 req-1eef5fcf-2201-45c3-b2eb-e710755d8b5e service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-6cab3da8-3ea6-441b-bcd8-d4c852eab0a2 req-1eef5fcf-2201-45c3-b2eb-e710755d8b5e service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] No waiting events found dispatching network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:05 user nova-compute[74889]: WARNING nova.compute.manager [req-6cab3da8-3ea6-441b-bcd8-d4c852eab0a2 req-1eef5fcf-2201-45c3-b2eb-e710755d8b5e service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received unexpected event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e055ae-45d3-4d2c-9703-e6f1dc9b4e9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[347efe16-195a-4c1e-bc24-25e7cfb2b6db]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 12:00:05 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 12:00:05 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:05 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:05 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 12:00:05 user nova-compute[74889]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 (non-flash)
Nov 10 12:00:05 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:05 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:05 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3882b4700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[784b497e-90b4-4366-bd00-c647a685054d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ad3140-30e4-42a5-89bf-2a6dc362e8c8]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d13f7-57a3-469a-b486-ee31d84ae32c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dfcd32-4745-4099-859d-6870e98f5035]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6138872-5c65-4abd-84da-4a62d808322f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a9af70-fe3c-4b35-8710-7ac6ba34d574]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260]
Nov 10 12:00:05 user nova-compute[74889]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9, portal: 172.16.0.220,3260] successful.
Nov 10 12:00:05 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f008cc-bb29-47ea-acbb-e97402d482b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa43b43-dae9-4370-92a9-4a3480885934]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== disconnect_volume: return (331ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:00:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Instance rebooted successfully.
Nov 10 12:00:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:00:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a38bcfa-c2f3-438f-b534-52bed0462c11 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.485s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:06 user nova-compute[74889]: DEBUG nova.objects.instance [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'flavor' on Instance uuid ff790962-c708-465c-a240-36748871cfda {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-be26f7e2-c61f-4dd6-9abf-d14dc4e4b18f tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-f5ca1e56-75c2-4bc7-af68-e7e3766e5962 req-7b23cefd-5ad1-4afa-9cdc-e50a5583c955 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-changed-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-f5ca1e56-75c2-4bc7-af68-e7e3766e5962 req-7b23cefd-5ad1-4afa-9cdc-e50a5583c955 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Refreshing instance network info cache due to event network-changed-9616e5e2-f3ec-455f-b303-9dd4bede6596. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:00:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f5ca1e56-75c2-4bc7-af68-e7e3766e5962 req-7b23cefd-5ad1-4afa-9cdc-e50a5583c955 service nova] Acquiring lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f5ca1e56-75c2-4bc7-af68-e7e3766e5962 req-7b23cefd-5ad1-4afa-9cdc-e50a5583c955 service nova] Acquired lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:10 user nova-compute[74889]: DEBUG nova.network.neutron [req-f5ca1e56-75c2-4bc7-af68-e7e3766e5962 req-7b23cefd-5ad1-4afa-9cdc-e50a5583c955 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Refreshing network info cache for port 9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:00:11 user nova-compute[74889]: DEBUG nova.network.neutron [req-f5ca1e56-75c2-4bc7-af68-e7e3766e5962 req-7b23cefd-5ad1-4afa-9cdc-e50a5583c955 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updated VIF entry in instance network info cache for port 9616e5e2-f3ec-455f-b303-9dd4bede6596. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:00:11 user nova-compute[74889]: DEBUG nova.network.neutron [req-f5ca1e56-75c2-4bc7-af68-e7e3766e5962 req-7b23cefd-5ad1-4afa-9cdc-e50a5583c955 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updating instance_info_cache with network_info: [{"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f5ca1e56-75c2-4bc7-af68-e7e3766e5962 req-7b23cefd-5ad1-4afa-9cdc-e50a5583c955 service nova] Releasing lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "interface-d6a0ffdd-1c72-4a34-b652-d14a01965ad5-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "interface-d6a0ffdd-1c72-4a34-b652-d14a01965ad5-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:12 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lazy-loading 'flavor' on Instance uuid d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:12 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lazy-loading 'pci_requests' on Instance uuid d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:12 user nova-compute[74889]: DEBUG nova.objects.base [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Object Instance<d6a0ffdd-1c72-4a34-b652-d14a01965ad5> lazy-loaded attributes: flavor,pci_requests {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:00:12 user nova-compute[74889]: DEBUG nova.network.neutron [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:00:12 user nova-compute[74889]: DEBUG nova.policy [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9f9a0d401cc4f53b97396ec66e5ac69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bfc5c65f3ec4fedb9b968e20399aeab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:00:13 user nova-compute[74889]: DEBUG nova.network.neutron [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Successfully created port: b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:00:13 user nova-compute[74889]: DEBUG nova.network.neutron [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Successfully updated port: b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:00:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquired lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:13 user nova-compute[74889]: DEBUG nova.network.neutron [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:00:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-ac8707b4-6c17-4c39-b2ab-d2a417073e55 req-efd88865-dcb5-4f92-af28-a534fb7972fa service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-changed-b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-ac8707b4-6c17-4c39-b2ab-d2a417073e55 req-efd88865-dcb5-4f92-af28-a534fb7972fa service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Refreshing instance network info cache due to event network-changed-b97913e7-3fad-42b9-8464-3e045a5d9f95. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:00:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ac8707b4-6c17-4c39-b2ab-d2a417073e55 req-efd88865-dcb5-4f92-af28-a534fb7972fa service nova] Acquiring lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG nova.network.neutron [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updating instance_info_cache with network_info: [{"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbEKjTGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:00:14 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:00:14 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:00:14 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b58e4a-25b2-43b2-a484-c8234091bdee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:00:14 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Releasing lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ac8707b4-6c17-4c39-b2ab-d2a417073e55 req-efd88865-dcb5-4f92-af28-a534fb7972fa service nova] Acquired lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG nova.network.neutron [req-ac8707b4-6c17-4c39-b2ab-d2a417073e55 req-efd88865-dcb5-4f92-af28-a534fb7972fa service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Refreshing network info cache for port b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021355343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021355343',id=15,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0vequKP+K5HhXnSZEekp/UTgizqm44CF7EwBTHzQ3YrW5/0KlwgVsmqJxdfyDOzcFvmhjOI1nY67HVgkbNSp+Wusi+soHfSh0U5hG8mvTVgzxbmEuelIU3LcM+ZQt2JQ==',key_name='tempest-keypair-1815934162',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:58:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9bfc5c65f3ec4fedb9b968e20399aeab',ramdisk_id='',reservation_id='r-sc38cubd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-866426842',owner_user_name='tempest-TaggedAttachmentsTest-866426842-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f9a0d401cc4f53b97396ec66e5ac69',uuid=d6a0ffdd-1c72-4a34-b652-d14a01965ad5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converting VIF {"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_vif [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9351738a-8cca-5697-91e5-bb02b173a3dd', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a78c4-a095-47bd-b5eb-6de1d55a9829]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117] added
Nov 10 12:00:14 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb97913e7-3f, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb97913e7-3f, col_values=(('qos', UUID('7a65a14b-82e4-4d00-acb5-576d5a7d49df')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb97913e7-3f, col_values=(('external_ids', {'iface-id': 'b97913e7-3fad-42b9-8464-3e045a5d9f95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:f1:48', 'vm-uuid': 'd6a0ffdd-1c72-4a34-b652-d14a01965ad5'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:14 user nova-compute[74889]: INFO os_vif [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f')
Nov 10 12:00:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021355343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021355343',id=15,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0vequKP+K5HhXnSZEekp/UTgizqm44CF7EwBTHzQ3YrW5/0KlwgVsmqJxdfyDOzcFvmhjOI1nY67HVgkbNSp+Wusi+soHfSh0U5hG8mvTVgzxbmEuelIU3LcM+ZQt2JQ==',key_name='tempest-keypair-1815934162',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:58:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9bfc5c65f3ec4fedb9b968e20399aeab',ramdisk_id='',reservation_id='r-sc38cubd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-866426842',owner_user_name='tempest-TaggedAttachmentsTest-866426842-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f9a0d401cc4f53b97396ec66e5ac69',uuid=d6a0ffdd-1c72-4a34-b652-d14a01965ad5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converting VIF {"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3cefb7-353d-46bf-b540-1f5adf3ae045]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] attach device xml: <interface type="ethernet">
Nov 10 12:00:14 user nova-compute[74889]:   <mac address="fa:16:3e:eb:f1:48"/>
Nov 10 12:00:14 user nova-compute[74889]:   <model type="virtio"/>
Nov 10 12:00:14 user nova-compute[74889]:   <mtu size="1442"/>
Nov 10 12:00:14 user nova-compute[74889]:   <target dev="tapb97913e7-3f"/>
Nov 10 12:00:14 user nova-compute[74889]: </interface>
Nov 10 12:00:14 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[270901e3-73c7-494e-9acf-033b24ff6d46]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbEKjTGV {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pbEKjTGV" returned: 0 in 0.031s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8493c08-cc39-4fd7-942c-036ca8bb49c7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pbEKjTGV'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b9637c-7abb-4c48-b122-6fdba6134291]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0387df10-215e-47a6-811e-82d0d00bd043]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 12:00:14 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:14 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:14 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 12:00:14 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:14 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:14 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d09774f-b658-48a6-ac7c-d5aec91e1f14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117, portal: 172.16.0.220,3260]
Nov 10 12:00:14 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117, portal: 172.16.0.220,3260] successful.
Nov 10 12:00:14 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[beff0399-3b82-451e-a450-56bfef0e0a31]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b84394b-0880-4698-8b9a-918f95bbea4f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 12:00:15 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:15 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:15 user nova-compute[74889]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 (non-flash)
Nov 10 12:00:15 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 12:00:15 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:15 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:15 user nova-compute[74889]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 (non-flash)
Nov 10 12:00:15 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.515s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15dbd85-ed2d-4253-8b56-24b536c5fbe8]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbEKjTGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-ac8707b4-6c17-4c39-b2ab-d2a417073e55 req-efd88865-dcb5-4f92-af28-a534fb7972fa service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updated VIF entry in instance network info cache for port b97913e7-3fad-42b9-8464-3e045a5d9f95. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-ac8707b4-6c17-4c39-b2ab-d2a417073e55 req-efd88865-dcb5-4f92-af28-a534fb7972fa service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updating instance_info_cache with network_info: [{"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ac8707b4-6c17-4c39-b2ab-d2a417073e55 req-efd88865-dcb5-4f92-af28-a534fb7972fa service nova] Releasing lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] No BDM found with device name hda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] No VIF found with MAC fa:16:3e:34:c5:6e, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:00:15 user nova-compute[74889]:   <nova:package version="0.0.0"/>
Nov 10 12:00:15 user nova-compute[74889]:   <nova:name>tempest-device-tagging-server-2021355343</nova:name>
Nov 10 12:00:15 user nova-compute[74889]:   <nova:creationTime>2023-11-10 12:00:15</nova:creationTime>
Nov 10 12:00:15 user nova-compute[74889]:   <nova:flavor name="m1.tiny">
Nov 10 12:00:15 user nova-compute[74889]:     <nova:memory>512</nova:memory>
Nov 10 12:00:15 user nova-compute[74889]:     <nova:disk>1</nova:disk>
Nov 10 12:00:15 user nova-compute[74889]:     <nova:swap>0</nova:swap>
Nov 10 12:00:15 user nova-compute[74889]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:00:15 user nova-compute[74889]:     <nova:vcpus>1</nova:vcpus>
Nov 10 12:00:15 user nova-compute[74889]:   </nova:flavor>
Nov 10 12:00:15 user nova-compute[74889]:   <nova:owner>
Nov 10 12:00:15 user nova-compute[74889]:     <nova:user uuid="d9f9a0d401cc4f53b97396ec66e5ac69">tempest-TaggedAttachmentsTest-866426842-project-member</nova:user>
Nov 10 12:00:15 user nova-compute[74889]:     <nova:project uuid="9bfc5c65f3ec4fedb9b968e20399aeab">tempest-TaggedAttachmentsTest-866426842</nova:project>
Nov 10 12:00:15 user nova-compute[74889]:   </nova:owner>
Nov 10 12:00:15 user nova-compute[74889]:   <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:00:15 user nova-compute[74889]:   <nova:ports>
Nov 10 12:00:15 user nova-compute[74889]:     <nova:port uuid="9616e5e2-f3ec-455f-b303-9dd4bede6596">
Nov 10 12:00:15 user nova-compute[74889]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:00:15 user nova-compute[74889]:     </nova:port>
Nov 10 12:00:15 user nova-compute[74889]:     <nova:port uuid="b97913e7-3fad-42b9-8464-3e045a5d9f95">
Nov 10 12:00:15 user nova-compute[74889]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Nov 10 12:00:15 user nova-compute[74889]:     </nova:port>
Nov 10 12:00:15 user nova-compute[74889]:   </nova:ports>
Nov 10 12:00:15 user nova-compute[74889]: </nova:instance>
Nov 10 12:00:15 user nova-compute[74889]:  {{(pid=74889) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-18a5b2cf-63c5-4db1-b092-bf51f10aedda req-ab7a38da-e6c8-4893-95d3-4fb7330da72d service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received event network-changed-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-18a5b2cf-63c5-4db1-b092-bf51f10aedda req-ab7a38da-e6c8-4893-95d3-4fb7330da72d service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Refreshing instance network info cache due to event network-changed-01fa2c48-958b-485c-b34e-b7ceb445bca4. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-18a5b2cf-63c5-4db1-b092-bf51f10aedda req-ab7a38da-e6c8-4893-95d3-4fb7330da72d service nova] Acquiring lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-18a5b2cf-63c5-4db1-b092-bf51f10aedda req-ab7a38da-e6c8-4893-95d3-4fb7330da72d service nova] Acquired lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-18a5b2cf-63c5-4db1-b092-bf51f10aedda req-ab7a38da-e6c8-4893-95d3-4fb7330da72d service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Refreshing network info cache for port 01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f6ca38f6-5076-4db1-b000-6b38c329abc7 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "interface-d6a0ffdd-1c72-4a34-b652-d14a01965ad5-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.038s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lazy-loading 'flavor' on Instance uuid d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-plugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] No waiting events found dispatching network-vif-plugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:15 user nova-compute[74889]: WARNING nova.compute.manager [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received unexpected event network-vif-plugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 for instance with vm_state active and task_state None.
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-plugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] No waiting events found dispatching network-vif-plugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:15 user nova-compute[74889]: WARNING nova.compute.manager [req-9a75a56f-ac3b-4e70-a858-96c663e77c6b req-7b908f3b-2ad3-4844-8524-13032e4dac55 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received unexpected event network-vif-plugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 for instance with vm_state active and task_state None.
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-18a5b2cf-63c5-4db1-b092-bf51f10aedda req-ab7a38da-e6c8-4893-95d3-4fb7330da72d service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Updated VIF entry in instance network info cache for port 01fa2c48-958b-485c-b34e-b7ceb445bca4. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-18a5b2cf-63c5-4db1-b092-bf51f10aedda req-ab7a38da-e6c8-4893-95d3-4fb7330da72d service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Updating instance_info_cache with network_info: [{"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-18a5b2cf-63c5-4db1-b092-bf51f10aedda req-ab7a38da-e6c8-4893-95d3-4fb7330da72d service nova] Releasing lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:16 user nova-compute[74889]: INFO nova.compute.manager [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Attaching volume 551451c4-b37e-4973-9bf3-87f6bea4ce0e to /dev/vdb
Nov 10 12:00:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.573s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] <== connect_volume: return (1575ms) {'type': 'block', 'scsi_wwn': '23632333632373062', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632333632373062', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lazy-loading 'flavor' on Instance uuid fc53bac7-d79d-4c33-af61-340b00dd8758 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:00:16 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:00:16 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:00:16 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:00:16 user nova-compute[74889]:   <serial>ae623441-bac2-4028-834b-79263c2f0117</serial>
Nov 10 12:00:16 user nova-compute[74889]: </disk>
Nov 10 12:00:16 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG os_brick.utils [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[901dae7a-0142-4dee-ac51-5d090e287157]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[15704b15-b2ff-4d22-9242-aabb41ef87dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[74eb4651-ba9c-4531-9cc7-710ba0402e0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e8350e-f5e1-4038-a7b5-9d33267e37f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:00:16 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17ca88e-bead-4346-bb79-143a1c60315a]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG os_brick.utils [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updating existing volume attachment record: ee86c81b-0212-4d34-a37d-52b1253c294e {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] No VIF found with MAC fa:16:3e:b5:58:ad, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:00:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4f9f6eae-1729-4e5c-bfa4-788ae4c6b1cd tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.438s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "fc53bac7-d79d-4c33-af61-340b00dd8758" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:18 user nova-compute[74889]: INFO nova.compute.manager [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Detaching volume ae623441-bac2-4028-834b-79263c2f0117
Nov 10 12:00:18 user nova-compute[74889]: INFO nova.virt.block_device [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Attempting to driver detach volume ae623441-bac2-4028-834b-79263c2f0117 from mountpoint /dev/vdb
Nov 10 12:00:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Attempting to detach device vdb from instance fc53bac7-d79d-4c33-af61-340b00dd8758 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:00:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:00:19 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:00:19 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:00:19 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:00:19 user nova-compute[74889]:   <serial>ae623441-bac2-4028-834b-79263c2f0117</serial>
Nov 10 12:00:19 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:00:19 user nova-compute[74889]: </disk>
Nov 10 12:00:19 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:00:19 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Successfully detached device vdb from instance fc53bac7-d79d-4c33-af61-340b00dd8758 from the persistent domain config.
Nov 10 12:00:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc53bac7-d79d-4c33-af61-340b00dd8758 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:00:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:00:19 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:00:19 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:00:19 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:00:19 user nova-compute[74889]:   <serial>ae623441-bac2-4028-834b-79263c2f0117</serial>
Nov 10 12:00:19 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:00:19 user nova-compute[74889]: </disk>
Nov 10 12:00:19 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:00:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc53bac7-d79d-4c33-af61-340b00dd8758 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:00:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:20 user nova-compute[74889]: INFO nova.compute.manager [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Detaching volume f9d58b72-227e-4817-a687-b415e8574584
Nov 10 12:00:21 user nova-compute[74889]: INFO nova.virt.block_device [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Attempting to driver detach volume f9d58b72-227e-4817-a687-b415e8574584 from mountpoint /dev/vdb
Nov 10 12:00:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Attempting to detach device vdb from instance 81cfb431-3aee-4081-82ba-49612a294d61 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:00:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:00:21 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:00:21 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:00:21 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:00:21 user nova-compute[74889]:   <serial>f9d58b72-227e-4817-a687-b415e8574584</serial>
Nov 10 12:00:21 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:00:21 user nova-compute[74889]: </disk>
Nov 10 12:00:21 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:00:21 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Successfully detached device vdb from instance 81cfb431-3aee-4081-82ba-49612a294d61 from the persistent domain config.
Nov 10 12:00:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81cfb431-3aee-4081-82ba-49612a294d61 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:00:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:00:21 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:00:21 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:00:21 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:00:21 user nova-compute[74889]:   <serial>f9d58b72-227e-4817-a687-b415e8574584</serial>
Nov 10 12:00:21 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:00:21 user nova-compute[74889]: </disk>
Nov 10 12:00:21 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:00:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81cfb431-3aee-4081-82ba-49612a294d61 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG nova.objects.instance [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'flavor' on Instance uuid 93367290-6fa4-4bbe-b47b-2dfa27227bed {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:22 user nova-compute[74889]: INFO nova.compute.manager [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Attaching volume bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d to /dev/vdb
Nov 10 12:00:22 user nova-compute[74889]: DEBUG os_brick.utils [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[968e29cb-69b0-4d2a-b248-67dfe134790a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fdc4a-3da2-4f23-9a45-256e294e32d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d03ffc-3312-4990-9166-b7c8b3e0f92b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b735552-e8d2-421f-b1eb-64604d29ea20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:00:22 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:00:22 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c89a3f-d08c-4b1a-b8c4-fa09c4b4ee66]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG os_brick.utils [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:00:22 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Updating existing volume attachment record: aa70dc58-c557-40bd-bbe7-e5a9a7332f7e {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:00:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:00:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:30 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:00:30 user nova-compute[74889]: INFO nova.compute.claims [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Claim successful on node user
Nov 10 12:00:31 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:00:31 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:00:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG nova.policy [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa5f0e22f91049d6ae70a72bc14df5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e625bfb83b44435db8d8935883a7995f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:00:31 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Creating image(s)
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "/opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "/opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk 1073741824" returned: 0 in 0.062s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG nova.network.neutron [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Successfully created port: 1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Cannot resize image /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Ensure instance console log exists: /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG nova.network.neutron [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Successfully updated port: 1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "refresh_cache-ef39ec05-9c6e-4f3f-9881-8777f72073a4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquired lock "refresh_cache-ef39ec05-9c6e-4f3f-9881-8777f72073a4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG nova.network.neutron [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-a77b8bc0-a559-445a-9abd-3475c39dd83e req-07daa209-3363-4e52-9c19-77ae3ec4e677 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Received event network-changed-1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-a77b8bc0-a559-445a-9abd-3475c39dd83e req-07daa209-3363-4e52-9c19-77ae3ec4e677 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Refreshing instance network info cache due to event network-changed-1aba17bd-57de-474a-b481-afaacef1d16e. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a77b8bc0-a559-445a-9abd-3475c39dd83e req-07daa209-3363-4e52-9c19-77ae3ec4e677 service nova] Acquiring lock "refresh_cache-ef39ec05-9c6e-4f3f-9881-8777f72073a4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:32 user nova-compute[74889]: DEBUG nova.network.neutron [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.network.neutron [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Updating instance_info_cache with network_info: [{"id": "1aba17bd-57de-474a-b481-afaacef1d16e", "address": "fa:16:3e:e1:a8:ff", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aba17bd-57", "ovs_interfaceid": "1aba17bd-57de-474a-b481-afaacef1d16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Releasing lock "refresh_cache-ef39ec05-9c6e-4f3f-9881-8777f72073a4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Instance network_info: |[{"id": "1aba17bd-57de-474a-b481-afaacef1d16e", "address": "fa:16:3e:e1:a8:ff", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aba17bd-57", "ovs_interfaceid": "1aba17bd-57de-474a-b481-afaacef1d16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a77b8bc0-a559-445a-9abd-3475c39dd83e req-07daa209-3363-4e52-9c19-77ae3ec4e677 service nova] Acquired lock "refresh_cache-ef39ec05-9c6e-4f3f-9881-8777f72073a4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.network.neutron [req-a77b8bc0-a559-445a-9abd-3475c39dd83e req-07daa209-3363-4e52-9c19-77ae3ec4e677 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Refreshing network info cache for port 1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Start _get_guest_xml network_info=[{"id": "1aba17bd-57de-474a-b481-afaacef1d16e", "address": "fa:16:3e:e1:a8:ff", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aba17bd-57", "ovs_interfaceid": "1aba17bd-57de-474a-b481-afaacef1d16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:00:33 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:00:33 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-344797124',display_name='tempest-ServersNegativeTestJSON-server-344797124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-344797124',id=21,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e625bfb83b44435db8d8935883a7995f',ramdisk_id='',reservation_id='r-008iv0ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1939998126',owner_user_name='tempest-ServersNegativeTestJSON-1939998126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:00:31Z,user_data=None,user_id='aa5f0e22f91049d6ae70a72bc14df5c7',uuid=ef39ec05-9c6e-4f3f-9881-8777f72073a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aba17bd-57de-474a-b481-afaacef1d16e", "address": "fa:16:3e:e1:a8:ff", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aba17bd-57", "ovs_interfaceid": "1aba17bd-57de-474a-b481-afaacef1d16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converting VIF {"id": "1aba17bd-57de-474a-b481-afaacef1d16e", "address": "fa:16:3e:e1:a8:ff", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aba17bd-57", "ovs_interfaceid": "1aba17bd-57de-474a-b481-afaacef1d16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=1aba17bd-57de-474a-b481-afaacef1d16e,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aba17bd-57') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.objects.instance [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lazy-loading 'pci_devices' on Instance uuid ef39ec05-9c6e-4f3f-9881-8777f72073a4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:00:33 user nova-compute[74889]:   <uuid>ef39ec05-9c6e-4f3f-9881-8777f72073a4</uuid>
Nov 10 12:00:33 user nova-compute[74889]:   <name>instance-00000015</name>
Nov 10 12:00:33 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:00:33 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:00:33 user nova-compute[74889]:   <metadata>
Nov 10 12:00:33 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:00:33 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:00:33 user nova-compute[74889]:       <nova:name>tempest-ServersNegativeTestJSON-server-344797124</nova:name>
Nov 10 12:00:33 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:00:33</nova:creationTime>
Nov 10 12:00:33 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:00:33 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:00:33 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:00:33 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:00:33 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:00:33 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:00:33 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:00:33 user nova-compute[74889]:       <nova:owner>
Nov 10 12:00:33 user nova-compute[74889]:         <nova:user uuid="aa5f0e22f91049d6ae70a72bc14df5c7">tempest-ServersNegativeTestJSON-1939998126-project-member</nova:user>
Nov 10 12:00:33 user nova-compute[74889]:         <nova:project uuid="e625bfb83b44435db8d8935883a7995f">tempest-ServersNegativeTestJSON-1939998126</nova:project>
Nov 10 12:00:33 user nova-compute[74889]:       </nova:owner>
Nov 10 12:00:33 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:00:33 user nova-compute[74889]:       <nova:ports>
Nov 10 12:00:33 user nova-compute[74889]:         <nova:port uuid="1aba17bd-57de-474a-b481-afaacef1d16e">
Nov 10 12:00:33 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 12:00:33 user nova-compute[74889]:         </nova:port>
Nov 10 12:00:33 user nova-compute[74889]:       </nova:ports>
Nov 10 12:00:33 user nova-compute[74889]:     </nova:instance>
Nov 10 12:00:33 user nova-compute[74889]:   </metadata>
Nov 10 12:00:33 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:00:33 user nova-compute[74889]:     <system>
Nov 10 12:00:33 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:00:33 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:00:33 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:00:33 user nova-compute[74889]:       <entry name="serial">ef39ec05-9c6e-4f3f-9881-8777f72073a4</entry>
Nov 10 12:00:33 user nova-compute[74889]:       <entry name="uuid">ef39ec05-9c6e-4f3f-9881-8777f72073a4</entry>
Nov 10 12:00:33 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:00:33 user nova-compute[74889]:     </system>
Nov 10 12:00:33 user nova-compute[74889]:   </sysinfo>
Nov 10 12:00:33 user nova-compute[74889]:   <os>
Nov 10 12:00:33 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:00:33 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:00:33 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:00:33 user nova-compute[74889]:   </os>
Nov 10 12:00:33 user nova-compute[74889]:   <features>
Nov 10 12:00:33 user nova-compute[74889]:     <acpi/>
Nov 10 12:00:33 user nova-compute[74889]:     <apic/>
Nov 10 12:00:33 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:00:33 user nova-compute[74889]:   </features>
Nov 10 12:00:33 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:00:33 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:00:33 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:00:33 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:00:33 user nova-compute[74889]:   </clock>
Nov 10 12:00:33 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:00:33 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:00:33 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:00:33 user nova-compute[74889]:   </cpu>
Nov 10 12:00:33 user nova-compute[74889]:   <devices>
Nov 10 12:00:33 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:00:33 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:00:33 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk"/>
Nov 10 12:00:33 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:00:33 user nova-compute[74889]:     </disk>
Nov 10 12:00:33 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:00:33 user nova-compute[74889]:       <mac address="fa:16:3e:e1:a8:ff"/>
Nov 10 12:00:33 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:00:33 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:00:33 user nova-compute[74889]:       <target dev="tap1aba17bd-57"/>
Nov 10 12:00:33 user nova-compute[74889]:     </interface>
Nov 10 12:00:33 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:00:33 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/console.log" append="off"/>
Nov 10 12:00:33 user nova-compute[74889]:     </serial>
Nov 10 12:00:33 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:00:33 user nova-compute[74889]:     <video>
Nov 10 12:00:33 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:00:33 user nova-compute[74889]:     </video>
Nov 10 12:00:33 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:00:33 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:00:33 user nova-compute[74889]:     </rng>
Nov 10 12:00:33 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:00:33 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:00:33 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:00:33 user nova-compute[74889]:     </memballoon>
Nov 10 12:00:33 user nova-compute[74889]:   </devices>
Nov 10 12:00:33 user nova-compute[74889]: </domain>
Nov 10 12:00:33 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-344797124',display_name='tempest-ServersNegativeTestJSON-server-344797124',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-344797124',id=21,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e625bfb83b44435db8d8935883a7995f',ramdisk_id='',reservation_id='r-008iv0ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1939998126',owner_user_name='tempest-ServersNegativeTestJSON-1939998126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:00:31Z,user_data=None,user_id='aa5f0e22f91049d6ae70a72bc14df5c7',uuid=ef39ec05-9c6e-4f3f-9881-8777f72073a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1aba17bd-57de-474a-b481-afaacef1d16e", "address": "fa:16:3e:e1:a8:ff", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aba17bd-57", "ovs_interfaceid": "1aba17bd-57de-474a-b481-afaacef1d16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converting VIF {"id": "1aba17bd-57de-474a-b481-afaacef1d16e", "address": "fa:16:3e:e1:a8:ff", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aba17bd-57", "ovs_interfaceid": "1aba17bd-57de-474a-b481-afaacef1d16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=1aba17bd-57de-474a-b481-afaacef1d16e,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aba17bd-57') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG os_vif [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=1aba17bd-57de-474a-b481-afaacef1d16e,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aba17bd-57') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb0f317a-b3fe-5a71-af66-74439ffe8aa5', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1aba17bd-57, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1aba17bd-57, col_values=(('qos', UUID('b1449408-8d1e-4e6c-8ab2-e60bef7fadcc')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1aba17bd-57, col_values=(('external_ids', {'iface-id': '1aba17bd-57de-474a-b481-afaacef1d16e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:a8:ff', 'vm-uuid': 'ef39ec05-9c6e-4f3f-9881-8777f72073a4'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:33 user nova-compute[74889]: INFO os_vif [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=1aba17bd-57de-474a-b481-afaacef1d16e,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aba17bd-57')
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] No VIF found with MAC fa:16:3e:e1:a8:ff, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.network.neutron [req-a77b8bc0-a559-445a-9abd-3475c39dd83e req-07daa209-3363-4e52-9c19-77ae3ec4e677 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Updated VIF entry in instance network info cache for port 1aba17bd-57de-474a-b481-afaacef1d16e. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG nova.network.neutron [req-a77b8bc0-a559-445a-9abd-3475c39dd83e req-07daa209-3363-4e52-9c19-77ae3ec4e677 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Updating instance_info_cache with network_info: [{"id": "1aba17bd-57de-474a-b481-afaacef1d16e", "address": "fa:16:3e:e1:a8:ff", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aba17bd-57", "ovs_interfaceid": "1aba17bd-57de-474a-b481-afaacef1d16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a77b8bc0-a559-445a-9abd-3475c39dd83e req-07daa209-3363-4e52-9c19-77ae3ec4e677 service nova] Releasing lock "refresh_cache-ef39ec05-9c6e-4f3f-9881-8777f72073a4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "ff790962-c708-465c-a240-36748871cfda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "ff790962-c708-465c-a240-36748871cfda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-f7ab39cc-d011-4ad6-832e-ec008aa4908d req-06ff6ebe-e834-4ddf-bbaa-0214e701358a service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Received event network-vif-plugged-1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f7ab39cc-d011-4ad6-832e-ec008aa4908d req-06ff6ebe-e834-4ddf-bbaa-0214e701358a service nova] Acquiring lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f7ab39cc-d011-4ad6-832e-ec008aa4908d req-06ff6ebe-e834-4ddf-bbaa-0214e701358a service nova] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f7ab39cc-d011-4ad6-832e-ec008aa4908d req-06ff6ebe-e834-4ddf-bbaa-0214e701358a service nova] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-f7ab39cc-d011-4ad6-832e-ec008aa4908d req-06ff6ebe-e834-4ddf-bbaa-0214e701358a service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] No waiting events found dispatching network-vif-plugged-1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:35 user nova-compute[74889]: WARNING nova.compute.manager [req-f7ab39cc-d011-4ad6-832e-ec008aa4908d req-06ff6ebe-e834-4ddf-bbaa-0214e701358a service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Received unexpected event network-vif-plugged-1aba17bd-57de-474a-b481-afaacef1d16e for instance with vm_state building and task_state spawning.
Nov 10 12:00:35 user nova-compute[74889]: INFO nova.compute.manager [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Terminating instance
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-62cadc08-6508-4bed-b52f-75b203c83a4a req-2638895d-8fe3-4297-8dc2-4c4334198995 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-vif-unplugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-62cadc08-6508-4bed-b52f-75b203c83a4a req-2638895d-8fe3-4297-8dc2-4c4334198995 service nova] Acquiring lock "ff790962-c708-465c-a240-36748871cfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-62cadc08-6508-4bed-b52f-75b203c83a4a req-2638895d-8fe3-4297-8dc2-4c4334198995 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-62cadc08-6508-4bed-b52f-75b203c83a4a req-2638895d-8fe3-4297-8dc2-4c4334198995 service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-62cadc08-6508-4bed-b52f-75b203c83a4a req-2638895d-8fe3-4297-8dc2-4c4334198995 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] No waiting events found dispatching network-vif-unplugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-62cadc08-6508-4bed-b52f-75b203c83a4a req-2638895d-8fe3-4297-8dc2-4c4334198995 service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-vif-unplugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: ff790962-c708-465c-a240-36748871cfda] Instance destroyed successfully.
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'resources' on Instance uuid ff790962-c708-465c-a240-36748871cfda {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T11:54:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-642189030',display_name='tempest-ServerActionsTestOtherA-server-273336335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-642189030',id=9,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0/XF+AB0GhusuxdUy4KCbA5BHH0mEXd6UsrJkBP5cRseQe4LcHZRtV1gX4Erce1ZdBd4lGhhKkzpZ8/b9Vm+ldnYnA6+7h9G9k9ev9qm8TXn29kna1Abvhrmq647o0WA==',key_name='tempest-keypair-958761505',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:57:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-fqz1x6s6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=ff790962-c708-465c-a240-36748871cfda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "address": "fa:16:3e:28:d7:7a", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cf86e63-f9", "ovs_interfaceid": "9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG os_vif [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cf86e63-f9, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad6c9fbc-e73d-48e0-839e-4f17bb42efa5) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:35 user nova-compute[74889]: INFO os_vif [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:d7:7a,bridge_name='br-int',has_traffic_filtering=True,id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cf86e63-f9')
Nov 10 12:00:35 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Deleting instance files /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda_del
Nov 10 12:00:35 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Deletion of /opt/stack/data/nova/instances/ff790962-c708-465c-a240-36748871cfda_del complete
Nov 10 12:00:35 user nova-compute[74889]: INFO nova.compute.manager [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: ff790962-c708-465c-a240-36748871cfda] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 12:00:35 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: ff790962-c708-465c-a240-36748871cfda] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:00:35 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: ff790962-c708-465c-a240-36748871cfda] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: ff790962-c708-465c-a240-36748871cfda] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-621cf26c-982a-4113-bd76-f795a31ddb48 req-f17b1c28-384a-4634-8c31-8c184ed3541d service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-vif-deleted-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:36 user nova-compute[74889]: INFO nova.compute.manager [req-621cf26c-982a-4113-bd76-f795a31ddb48 req-f17b1c28-384a-4634-8c31-8c184ed3541d service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Neutron deleted interface 9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53; detaching it from the instance and deleting it from the info cache
Nov 10 12:00:36 user nova-compute[74889]: DEBUG nova.network.neutron [req-621cf26c-982a-4113-bd76-f795a31ddb48 req-f17b1c28-384a-4634-8c31-8c184ed3541d service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:36 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: ff790962-c708-465c-a240-36748871cfda] Took 0.83 seconds to deallocate network for instance.
Nov 10 12:00:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-621cf26c-982a-4113-bd76-f795a31ddb48 req-f17b1c28-384a-4634-8c31-8c184ed3541d service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Detach interface failed, port_id=9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53, reason: Instance ff790962-c708-465c-a240-36748871cfda could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-6d2c9fd3-9d08-4851-b255-f1072942470c req-4fa450a9-0f40-4caf-b64b-c570edfd141e service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Received event network-vif-plugged-1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6d2c9fd3-9d08-4851-b255-f1072942470c req-4fa450a9-0f40-4caf-b64b-c570edfd141e service nova] Acquiring lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6d2c9fd3-9d08-4851-b255-f1072942470c req-4fa450a9-0f40-4caf-b64b-c570edfd141e service nova] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6d2c9fd3-9d08-4851-b255-f1072942470c req-4fa450a9-0f40-4caf-b64b-c570edfd141e service nova] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-6d2c9fd3-9d08-4851-b255-f1072942470c req-4fa450a9-0f40-4caf-b64b-c570edfd141e service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] No waiting events found dispatching network-vif-plugged-1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:37 user nova-compute[74889]: WARNING nova.compute.manager [req-6d2c9fd3-9d08-4851-b255-f1072942470c req-4fa450a9-0f40-4caf-b64b-c570edfd141e service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Received unexpected event network-vif-plugged-1aba17bd-57de-474a-b481-afaacef1d16e for instance with vm_state building and task_state spawning.
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:00:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Instance spawned successfully.
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:37 user nova-compute[74889]: INFO nova.compute.manager [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:37 user nova-compute[74889]: INFO nova.compute.manager [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Took 6.70 seconds to build instance.
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-9f5debc7-45fc-4c98-b410-ce7569a51158 req-dd7fa344-cb38-494a-ab9c-a1ab3e0c342b service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f5debc7-45fc-4c98-b410-ce7569a51158 req-dd7fa344-cb38-494a-ab9c-a1ab3e0c342b service nova] Acquiring lock "ff790962-c708-465c-a240-36748871cfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f5debc7-45fc-4c98-b410-ce7569a51158 req-dd7fa344-cb38-494a-ab9c-a1ab3e0c342b service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f5debc7-45fc-4c98-b410-ce7569a51158 req-dd7fa344-cb38-494a-ab9c-a1ab3e0c342b service nova] Lock "ff790962-c708-465c-a240-36748871cfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-9f5debc7-45fc-4c98-b410-ce7569a51158 req-dd7fa344-cb38-494a-ab9c-a1ab3e0c342b service nova] [instance: ff790962-c708-465c-a240-36748871cfda] No waiting events found dispatching network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:37 user nova-compute[74889]: WARNING nova.compute.manager [req-9f5debc7-45fc-4c98-b410-ce7569a51158 req-dd7fa344-cb38-494a-ab9c-a1ab3e0c342b service nova] [instance: ff790962-c708-465c-a240-36748871cfda] Received unexpected event network-vif-plugged-9cf86e63-f9ef-4759-afd4-ebd9b4a8cd53 for instance with vm_state deleted and task_state None.
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-31517a29-0cc4-4a09-bf57-4dd81d001bcc tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.816s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.604s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:37 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Deleted allocations for instance ff790962-c708-465c-a240-36748871cfda
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ba636b69-38dd-44bc-886f-b5e4ff9233ed tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "ff790962-c708-465c-a240-36748871cfda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.679s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:38 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid 'ff790962-c708-465c-a240-36748871cfda' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ff790962-c708-465c-a240-36748871cfda' (instance-00000009)
Nov 10 12:00:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc53bac7-d79d-4c33-af61-340b00dd8758 is timed out.
Nov 10 12:00:39 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Successfully detached device vdb from instance fc53bac7-d79d-4c33-af61-340b00dd8758 from the live domain config.
Nov 10 12:00:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pbEKjTGV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:00:39 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfdf2e3-2281-4d09-bd96-b28a1e3e6f63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:00:39 user nova-compute[74889]: No targets found.
Nov 10 12:00:39 user nova-compute[74889]: iSNS:
Nov 10 12:00:39 user nova-compute[74889]: No targets found.
Nov 10 12:00:39 user nova-compute[74889]: STATIC:
Nov 10 12:00:39 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584
Nov 10 12:00:39 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:39 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:39 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a
Nov 10 12:00:39 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:39 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:39 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117
Nov 10 12:00:39 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:39 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:39 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad
Nov 10 12:00:39 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:39 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:39 user nova-compute[74889]: FIRMWARE:
Nov 10 12:00:39 user nova-compute[74889]: No targets found.
Nov 10 12:00:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:00:39 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:00:39 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cc1763-ba4b-4f83-9e4d-d8d0122e6f2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a04dd8c-8b27-4a46-ad17-a3844f4543b6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 12:00:39 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:39 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:39 user nova-compute[74889]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 (non-flash)
Nov 10 12:00:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 12:00:39 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:39 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:39 user nova-compute[74889]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 (non-flash)
Nov 10 12:00:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a0074670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[991287f0-6643-4128-8952-5eee9086d373]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1f4c8a-08c1-45ae-9015-54e48295f6c1]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c582cac9-8745-4e9d-b666-029c5d42e070]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[add3d37a-0402-4363-b208-fbc3dd40a7c9]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38f3cf6-24f2-4c79-9a53-60c8e4c44d99]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f850f738-8aa9-4cb8-8f16-0f699bbd1e91]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117, portal: 172.16.0.220,3260]
Nov 10 12:00:39 user nova-compute[74889]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117, portal: 172.16.0.220,3260] successful.
Nov 10 12:00:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae623441-bac2-4028-834b-79263c2f0117 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[780644f6-01c5-4edd-8c49-13364f8e0424]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] <== disconnect_volume: return (385ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-f1e87d72-a1fa-41c5-a88e-e3c96a93ef54 req-f0f18529-ea71-43d2-bee8-faf35dd4eb4f service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-changed-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-f1e87d72-a1fa-41c5-a88e-e3c96a93ef54 req-f0f18529-ea71-43d2-bee8-faf35dd4eb4f service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Refreshing instance network info cache due to event network-changed-cf06308d-3f2e-40e2-b778-561b0c14eea0. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f1e87d72-a1fa-41c5-a88e-e3c96a93ef54 req-f0f18529-ea71-43d2-bee8-faf35dd4eb4f service nova] Acquiring lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f1e87d72-a1fa-41c5-a88e-e3c96a93ef54 req-f0f18529-ea71-43d2-bee8-faf35dd4eb4f service nova] Acquired lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG nova.network.neutron [req-f1e87d72-a1fa-41c5-a88e-e3c96a93ef54 req-f0f18529-ea71-43d2-bee8-faf35dd4eb4f service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Refreshing network info cache for port cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:40 user nova-compute[74889]: INFO nova.compute.manager [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Shelve offloading
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-f1e87d72-a1fa-41c5-a88e-e3c96a93ef54 req-f0f18529-ea71-43d2-bee8-faf35dd4eb4f service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updated VIF entry in instance network info cache for port cf06308d-3f2e-40e2-b778-561b0c14eea0. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:00:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-f1e87d72-a1fa-41c5-a88e-e3c96a93ef54 req-f0f18529-ea71-43d2-bee8-faf35dd4eb4f service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating instance_info_cache with network_info: [{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f1e87d72-a1fa-41c5-a88e-e3c96a93ef54 req-f0f18529-ea71-43d2-bee8-faf35dd4eb4f service nova] Releasing lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:41 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81cfb431-3aee-4081-82ba-49612a294d61 is timed out.
Nov 10 12:00:41 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Successfully detached device vdb from instance 81cfb431-3aee-4081-82ba-49612a294d61 from the live domain config.
Nov 10 12:00:42 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:00:42 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=6854MB free_disk=25.226226806640625GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:42 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Instance destroyed successfully.
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FRgcABxD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:00:42 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquired lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d4cdfc-c4e4-4072-aa78-1e9f0c9f05ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:00:42 user nova-compute[74889]: No targets found.
Nov 10 12:00:42 user nova-compute[74889]: iSNS:
Nov 10 12:00:42 user nova-compute[74889]: No targets found.
Nov 10 12:00:42 user nova-compute[74889]: STATIC:
Nov 10 12:00:42 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584
Nov 10 12:00:42 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:42 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:42 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a
Nov 10 12:00:42 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:42 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:42 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad
Nov 10 12:00:42 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:42 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:42 user nova-compute[74889]: FIRMWARE:
Nov 10 12:00:42 user nova-compute[74889]: No targets found.
Nov 10 12:00:42 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:00:42 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:00:42 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a811a9e-9e4a-4128-9507-fee2330d8bb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3167b59-d166-4f46-ba79-f92b5c3fe7be]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 12:00:42 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:42 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:42 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 (non-flash)
Nov 10 12:00:42 user nova-compute[74889]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:42 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:42 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a009f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584'): ({'sde'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Removing single pathed devices sde {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c918d392-5277-4970-960a-7466ea1baaeb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1951e2e5-055c-48de-857f-62714187d328]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Flushing IO for device /dev/sde {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3b70ab-216a-4dfa-903b-5be95de92efc]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6200554d-5be6-48b4-90e9-4151006d8ce3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 81cfb431-3aee-4081-82ba-49612a294d61 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 61077e59-6249-4a6e-b749-733ed9735bb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance fc53bac7-d79d-4c33-af61-340b00dd8758 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 93367290-6fa4-4bbe-b47b-2dfa27227bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 22718082-4c44-4384-8692-c216bb1a14e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 78fe06d2-9353-4b9a-8e34-2261f2f77fce actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 99116b0a-7426-4846-9a4b-dcf0bba5409f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance e71c6401-13be-4906-9988-2687a67bb50f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance ef39ec05-9c6e-4f3f-9881-8777f72073a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de5a67f-535b-40ac-8ca0-9c0b0e861748]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5fc912-d92d-4213-aad8-afbc1f69be5a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[24acf1bf-17a4-4203-82dc-8d44ad8d6718]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584, portal: 172.16.0.220,3260]
Nov 10 12:00:42 user nova-compute[74889]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584, portal: 172.16.0.220,3260] successful.
Nov 10 12:00:42 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9d58b72-227e-4817-a687-b415e8574584 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[02de4f14-3273-4ea3-99fc-45e03c75e513]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] <== disconnect_volume: return (342ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-vif-unplugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] No waiting events found dispatching network-vif-unplugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:42 user nova-compute[74889]: WARNING nova.compute.manager [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received unexpected event network-vif-unplugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 for instance with vm_state active and task_state shelving.
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] No waiting events found dispatching network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:42 user nova-compute[74889]: WARNING nova.compute.manager [req-8b794444-722f-408c-92c9-5fd01ee5409f req-91da93df-c2fe-49b6-8283-e1a554a41ec2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received unexpected event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 for instance with vm_state active and task_state shelving.
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating instance_info_cache with network_info: [{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.642s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Releasing lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.objects.instance [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lazy-loading 'flavor' on Instance uuid fc53bac7-d79d-4c33-af61-340b00dd8758 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-30602bca-7557-40b5-9ca3-c91d8e936226 tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.899s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksNROXwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:00:42 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:00:42 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:00:42 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcca376b-07ee-4701-858d-1956c4a7a33b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:00:42 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6280c14e-3a35-48fc-a921-8d27f9650e6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e] added
Nov 10 12:00:42 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20a3487-eb5e-41a9-8e9d-680597cea15c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdc8d8b-fbed-4670-80fd-9e3ea3586c86]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksNROXwg {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ksNROXwg" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[532efdec-fec0-47c7-8d59-50ec97641aee]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ksNROXwg'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aec9bc1-b3b5-4ad5-ab26-26596cfd3107]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1fce1c-b1aa-46ff-ae22-59d6752f2a2e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:43 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:43 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:43 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:43 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8084d7ea-e8fc-4b49-8618-8d2474f2c93d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e, portal: 172.16.0.220,3260]
Nov 10 12:00:43 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e, portal: 172.16.0.220,3260] successful.
Nov 10 12:00:43 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb070c7-f26d-4e14-a5bb-29eac55962c1]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[865a7542-91c6-42a2-9d9f-e72e8f6752e4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:43 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:43 user nova-compute[74889]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)
Nov 10 12:00:43 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:43 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:43 user nova-compute[74889]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)
Nov 10 12:00:43 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c702113b-80a6-45a1-acd5-5778bcdb4cc0]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksNROXwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:00:43 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Instance destroyed successfully.
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lazy-loading 'resources' on Instance uuid 78fe06d2-9353-4b9a-8e34-2261f2f77fce {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1185042267',display_name='tempest-TestShelveInstance-server-1185042267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1185042267',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPodj8RVFRnA92GtRbLa/y5HXflW20ag/voq9r2ZeH0NpyQGRj3+WFhoAPh5CJmLOMRCKMA5LPKPCnUOg3GfcAzioslG0YE6FCboauaqDG5i1iJyS8KJnGXK3pKJSV0HRA==',key_name='tempest-TestShelveInstance-551479707',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63ecf83da57e42c893ec51707cc19d00',ramdisk_id='',reservation_id='r-5a4kdpl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1459906128',owner_user_name='tempest-TestShelveInstance-1459906128-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:59:19Z,user_data=None,user_id='02ca978ddde34a69944046e0ca2ad504',uuid=78fe06d2-9353-4b9a-8e34-2261f2f77fce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converting VIF {"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_vif [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf06308d-3f, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-c1cf2be4-8ccb-4640-9b56-d0d2cf79b97b req-3e9b3c32-123c-4ceb-b440-f099a5c9080e service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-changed-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-c1cf2be4-8ccb-4640-9b56-d0d2cf79b97b req-3e9b3c32-123c-4ceb-b440-f099a5c9080e service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Refreshing instance network info cache due to event network-changed-cf06308d-3f2e-40e2-b778-561b0c14eea0. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1cf2be4-8ccb-4640-9b56-d0d2cf79b97b req-3e9b3c32-123c-4ceb-b440-f099a5c9080e service nova] Acquiring lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1cf2be4-8ccb-4640-9b56-d0d2cf79b97b req-3e9b3c32-123c-4ceb-b440-f099a5c9080e service nova] Acquired lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.network.neutron [req-c1cf2be4-8ccb-4640-9b56-d0d2cf79b97b req-3e9b3c32-123c-4ceb-b440-f099a5c9080e service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Refreshing network info cache for port cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c97b8c3-e86e-4695-a93f-b5209a7e15d8) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:00:43 user nova-compute[74889]: INFO os_vif [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f')
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuiXrEFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:00:43 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:00:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.network.neutron [req-c1cf2be4-8ccb-4640-9b56-d0d2cf79b97b req-3e9b3c32-123c-4ceb-b440-f099a5c9080e service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updated VIF entry in instance network info cache for port cf06308d-3f2e-40e2-b778-561b0c14eea0. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.network.neutron [req-c1cf2be4-8ccb-4640-9b56-d0d2cf79b97b req-3e9b3c32-123c-4ceb-b440-f099a5c9080e service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating instance_info_cache with network_info: [{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": null, "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcf06308d-3f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1cf2be4-8ccb-4640-9b56-d0d2cf79b97b req-3e9b3c32-123c-4ceb-b440-f099a5c9080e service nova] Releasing lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lazy-loading 'flavor' on Instance uuid 81cfb431-3aee-4081-82ba-49612a294d61 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1aa8f435-b306-4648-970b-a6f2cab654ab tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.165s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Updating instance_info_cache with network_info: [{"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-81cfb431-3aee-4081-82ba-49612a294d61" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23938636136646665', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938636136646665', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.883s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lazy-loading 'flavor' on Instance uuid d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba269e6-b962-4f8c-b126-120addea42fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:00:44 user nova-compute[74889]: No targets found.
Nov 10 12:00:44 user nova-compute[74889]: iSNS:
Nov 10 12:00:44 user nova-compute[74889]: No targets found.
Nov 10 12:00:44 user nova-compute[74889]: STATIC:
Nov 10 12:00:44 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a
Nov 10 12:00:44 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:44 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:44 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e
Nov 10 12:00:44 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:44 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:44 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad
Nov 10 12:00:44 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:00:44 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:00:44 user nova-compute[74889]: FIRMWARE:
Nov 10 12:00:44 user nova-compute[74889]: No targets found.
Nov 10 12:00:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:00:44 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:00:44 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:00:44 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:00:44 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:00:44 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:00:44 user nova-compute[74889]:   <serial>551451c4-b37e-4973-9bf3-87f6bea4ce0e</serial>
Nov 10 12:00:44 user nova-compute[74889]: </disk>
Nov 10 12:00:44 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[285f3355-fc57-4e17-9fc5-e15324206ce1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[595f91a1-e272-4352-95a5-796fb81b3fce]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:44 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:44 user nova-compute[74889]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)
Nov 10 12:00:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:00:44 user nova-compute[74889]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:44 user nova-compute[74889]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)
Nov 10 12:00:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a01d1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ebb17e-4fc0-4bd8-8e81-d7c3557dcfb0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8d963c-e734-4f06-9173-ec2fdb60221e]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca160d7-e76e-46e4-a56c-5951509cd4c7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3227e2f5-0e0b-497e-b7ff-6ed5e7d38917]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c53984-ce4c-4454-b1cd-fcdf4acd5bf0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aef389-9b17-4d5a-ace2-1e2131f778ce]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260]
Nov 10 12:00:44 user nova-compute[74889]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260] successful.
Nov 10 12:00:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[093bbc67-f44c-4372-a16b-f7838188aa0d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] <== disconnect_volume: return (1190ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:00:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Deleting instance files /opt/stack/data/nova/instances/78fe06d2-9353-4b9a-8e34-2261f2f77fce_del
Nov 10 12:00:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Deletion of /opt/stack/data/nova/instances/78fe06d2-9353-4b9a-8e34-2261f2f77fce_del complete
Nov 10 12:00:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] No BDM found with device name hda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] No VIF found with MAC fa:16:3e:34:c5:6e, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:00:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6ff3ef6c-0e4f-44b7-92cc-10654f61a26d tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.833s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:45 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:00:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:00:45 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Deleted allocations for instance 78fe06d2-9353-4b9a-8e34-2261f2f77fce
Nov 10 12:00:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:45 user nova-compute[74889]: INFO nova.compute.manager [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Detaching volume 551451c4-b37e-4973-9bf3-87f6bea4ce0e
Nov 10 12:00:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:45 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lazy-loading 'numa_topology' on Instance uuid 78fe06d2-9353-4b9a-8e34-2261f2f77fce {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:45 user nova-compute[74889]: DEBUG nova.objects.base [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Object Instance<78fe06d2-9353-4b9a-8e34-2261f2f77fce> lazy-loaded attributes: resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:00:45 user nova-compute[74889]: INFO nova.virt.block_device [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Attempting to driver detach volume 551451c4-b37e-4973-9bf3-87f6bea4ce0e from mountpoint /dev/vdb
Nov 10 12:00:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Attempting to detach device vdb from instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:00:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:00:45 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:00:45 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:00:45 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:00:45 user nova-compute[74889]:   <serial>551451c4-b37e-4973-9bf3-87f6bea4ce0e</serial>
Nov 10 12:00:45 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 12:00:45 user nova-compute[74889]: </disk>
Nov 10 12:00:45 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:00:46 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Successfully detached device vdb from instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 from the persistent domain config.
Nov 10 12:00:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:00:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:00:46 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:00:46 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:00:46 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:00:46 user nova-compute[74889]:   <serial>551451c4-b37e-4973-9bf3-87f6bea4ce0e</serial>
Nov 10 12:00:46 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 12:00:46 user nova-compute[74889]: </disk>
Nov 10 12:00:46 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:00:46 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:00:46 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:00:46 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:00:46 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:00:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.556s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6bab47d5-62dc-428d-867e-a1e803d98edf tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.605s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umkqRVGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:00:48 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:00:48 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:00:48 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d0e8a2-28b0-4feb-a06d-dad383a344de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:00:48 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a81286-aca3-4df3-8f61-d6bc6a1395b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d] added
Nov 10 12:00:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1e01da-23d3-40e1-b024-3b13e5c94ce8]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c398fd02-a1df-4527-98fd-665539b38d94]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umkqRVGX {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v umkqRVGX" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[984e05aa-7572-4001-a0f7-67287d7a4c7b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'umkqRVGX'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e72d95-cca9-4e50-a888-4aa8a51b3568]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d700ceb3-0ec7-45d8-a586-f37df1d64d96]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:48 user nova-compute[74889]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)
Nov 10 12:00:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:48 user nova-compute[74889]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)
Nov 10 12:00:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf84404-3374-450f-a3b8-a90fce65af29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d, portal: 172.16.0.220,3260]
Nov 10 12:00:48 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d, portal: 172.16.0.220,3260] successful.
Nov 10 12:00:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7331222f-997e-4a83-9c92-7846ab331a38]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dacfd7-193c-416e-a0bb-8d0dcacc1b31]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:48 user nova-compute[74889]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)
Nov 10 12:00:48 user nova-compute[74889]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:00:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:00:48 user nova-compute[74889]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)
Nov 10 12:00:48 user nova-compute[74889]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:00:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f4f616-02b8-4d5b-8adf-64f23047d496]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:00:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umkqRVGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:00:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:00:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23965393435626338', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:00:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965393435626338', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:00:49 user nova-compute[74889]: DEBUG nova.objects.instance [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'flavor' on Instance uuid 93367290-6fa4-4bbe-b47b-2dfa27227bed {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:00:49 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:00:49 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 12:00:49 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:00:49 user nova-compute[74889]:   <serial>bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d</serial>
Nov 10 12:00:49 user nova-compute[74889]: </disk>
Nov 10 12:00:49 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:00:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:00:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:00:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No VIF found with MAC fa:16:3e:fc:fa:dc, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:00:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90c950f6-dbc9-44f9-8651-5e820245a514 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.437s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:00:53 user nova-compute[74889]: INFO nova.compute.claims [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Claim successful on node user
Nov 10 12:00:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:00:53 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.policy [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3485bf67f27e4b72868b0adc1225bfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6ad4f23d94494b3f42cdbc7fd4516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:00:53 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Creating image(s)
Nov 10 12:00:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "/opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "/opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "/opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.248s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk 1073741824" returned: 0 in 0.052s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Successfully created port: 48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Cannot resize image /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Ensure instance console log exists: /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Successfully updated port: 48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "refresh_cache-44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquired lock "refresh_cache-44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.compute.manager [req-84b33d6f-b57c-49ec-8c10-15fe393d5267 req-51350614-2cc7-41b4-a1e5-b03062a3b429 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-changed-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.compute.manager [req-84b33d6f-b57c-49ec-8c10-15fe393d5267 req-51350614-2cc7-41b4-a1e5-b03062a3b429 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Refreshing instance network info cache due to event network-changed-48bc9f95-bf34-4076-b2cc-f42c55031c09. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-84b33d6f-b57c-49ec-8c10-15fe393d5267 req-51350614-2cc7-41b4-a1e5-b03062a3b429 service nova] Acquiring lock "refresh_cache-44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Updating instance_info_cache with network_info: [{"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Releasing lock "refresh_cache-44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Instance network_info: |[{"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-84b33d6f-b57c-49ec-8c10-15fe393d5267 req-51350614-2cc7-41b4-a1e5-b03062a3b429 service nova] Acquired lock "refresh_cache-44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.neutron [req-84b33d6f-b57c-49ec-8c10-15fe393d5267 req-51350614-2cc7-41b4-a1e5-b03062a3b429 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Refreshing network info cache for port 48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Start _get_guest_xml network_info=[{"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:00:55 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:00:55 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1467866079',display_name='tempest-AttachVolumeNegativeTest-server-1467866079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1467866079',id=22,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYAg/9w7gBTZdiTejRLbLCJ+Elw5JnBgXD3iLN2qmd3vfI58OZg1xu2+tyqouGxTEvr2YgtE+nwwkpAvegjgXyzVCRZcw1sDlj/tELJNE5gWukTdMcKzvqCwagDD9mMAQ==',key_name='tempest-keypair-537571039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-ard1l2mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=48bc9f95-bf34-4076-b2cc-f42c55031c09,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bc9f95-bf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'pci_devices' on Instance uuid 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:00:55 user nova-compute[74889]:   <uuid>44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02</uuid>
Nov 10 12:00:55 user nova-compute[74889]:   <name>instance-00000016</name>
Nov 10 12:00:55 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:00:55 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:00:55 user nova-compute[74889]:   <metadata>
Nov 10 12:00:55 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:00:55 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:00:55 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1467866079</nova:name>
Nov 10 12:00:55 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:00:55</nova:creationTime>
Nov 10 12:00:55 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:00:55 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:00:55 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:00:55 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:00:55 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:00:55 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:00:55 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:00:55 user nova-compute[74889]:       <nova:owner>
Nov 10 12:00:55 user nova-compute[74889]:         <nova:user uuid="3485bf67f27e4b72868b0adc1225bfeb">tempest-AttachVolumeNegativeTest-238498304-project-member</nova:user>
Nov 10 12:00:55 user nova-compute[74889]:         <nova:project uuid="80c6ad4f23d94494b3f42cdbc7fd4516">tempest-AttachVolumeNegativeTest-238498304</nova:project>
Nov 10 12:00:55 user nova-compute[74889]:       </nova:owner>
Nov 10 12:00:55 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:00:55 user nova-compute[74889]:       <nova:ports>
Nov 10 12:00:55 user nova-compute[74889]:         <nova:port uuid="48bc9f95-bf34-4076-b2cc-f42c55031c09">
Nov 10 12:00:55 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 12:00:55 user nova-compute[74889]:         </nova:port>
Nov 10 12:00:55 user nova-compute[74889]:       </nova:ports>
Nov 10 12:00:55 user nova-compute[74889]:     </nova:instance>
Nov 10 12:00:55 user nova-compute[74889]:   </metadata>
Nov 10 12:00:55 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:00:55 user nova-compute[74889]:     <system>
Nov 10 12:00:55 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:00:55 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:00:55 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:00:55 user nova-compute[74889]:       <entry name="serial">44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02</entry>
Nov 10 12:00:55 user nova-compute[74889]:       <entry name="uuid">44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02</entry>
Nov 10 12:00:55 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:00:55 user nova-compute[74889]:     </system>
Nov 10 12:00:55 user nova-compute[74889]:   </sysinfo>
Nov 10 12:00:55 user nova-compute[74889]:   <os>
Nov 10 12:00:55 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:00:55 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:00:55 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:00:55 user nova-compute[74889]:   </os>
Nov 10 12:00:55 user nova-compute[74889]:   <features>
Nov 10 12:00:55 user nova-compute[74889]:     <acpi/>
Nov 10 12:00:55 user nova-compute[74889]:     <apic/>
Nov 10 12:00:55 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:00:55 user nova-compute[74889]:   </features>
Nov 10 12:00:55 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:00:55 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:00:55 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:00:55 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:00:55 user nova-compute[74889]:   </clock>
Nov 10 12:00:55 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:00:55 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:00:55 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:00:55 user nova-compute[74889]:   </cpu>
Nov 10 12:00:55 user nova-compute[74889]:   <devices>
Nov 10 12:00:55 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:00:55 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:00:55 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk"/>
Nov 10 12:00:55 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:00:55 user nova-compute[74889]:     </disk>
Nov 10 12:00:55 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:00:55 user nova-compute[74889]:       <mac address="fa:16:3e:b5:cf:cd"/>
Nov 10 12:00:55 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:00:55 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:00:55 user nova-compute[74889]:       <target dev="tap48bc9f95-bf"/>
Nov 10 12:00:55 user nova-compute[74889]:     </interface>
Nov 10 12:00:55 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:00:55 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/console.log" append="off"/>
Nov 10 12:00:55 user nova-compute[74889]:     </serial>
Nov 10 12:00:55 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:00:55 user nova-compute[74889]:     <video>
Nov 10 12:00:55 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:00:55 user nova-compute[74889]:     </video>
Nov 10 12:00:55 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:00:55 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:00:55 user nova-compute[74889]:     </rng>
Nov 10 12:00:55 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:00:55 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:00:55 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:00:55 user nova-compute[74889]:     </memballoon>
Nov 10 12:00:55 user nova-compute[74889]:   </devices>
Nov 10 12:00:55 user nova-compute[74889]: </domain>
Nov 10 12:00:55 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1467866079',display_name='tempest-AttachVolumeNegativeTest-server-1467866079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1467866079',id=22,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYAg/9w7gBTZdiTejRLbLCJ+Elw5JnBgXD3iLN2qmd3vfI58OZg1xu2+tyqouGxTEvr2YgtE+nwwkpAvegjgXyzVCRZcw1sDlj/tELJNE5gWukTdMcKzvqCwagDD9mMAQ==',key_name='tempest-keypair-537571039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-ard1l2mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=48bc9f95-bf34-4076-b2cc-f42c55031c09,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bc9f95-bf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG os_vif [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=48bc9f95-bf34-4076-b2cc-f42c55031c09,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bc9f95-bf') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb0d91d2-0e7f-5212-a855-b37fdd8c1b81', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48bc9f95-bf, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48bc9f95-bf, col_values=(('qos', UUID('57e016dc-ead1-4614-ad49-f15c1f20bc80')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48bc9f95-bf, col_values=(('external_ids', {'iface-id': '48bc9f95-bf34-4076-b2cc-f42c55031c09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:cf:cd', 'vm-uuid': '44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:55 user nova-compute[74889]: INFO os_vif [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=48bc9f95-bf34-4076-b2cc-f42c55031c09,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bc9f95-bf')
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No VIF found with MAC fa:16:3e:b5:cf:cd, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.neutron [req-84b33d6f-b57c-49ec-8c10-15fe393d5267 req-51350614-2cc7-41b4-a1e5-b03062a3b429 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Updated VIF entry in instance network info cache for port 48bc9f95-bf34-4076-b2cc-f42c55031c09. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG nova.network.neutron [req-84b33d6f-b57c-49ec-8c10-15fe393d5267 req-51350614-2cc7-41b4-a1e5-b03062a3b429 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Updating instance_info_cache with network_info: [{"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:00:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-84b33d6f-b57c-49ec-8c10-15fe393d5267 req-51350614-2cc7-41b4-a1e5-b03062a3b429 service nova] Releasing lock "refresh_cache-44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:00:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:57 user nova-compute[74889]: DEBUG nova.compute.manager [req-626b1219-8f8c-48f8-9e02-40c257ba0536 req-0e6d5a8e-6865-45be-9f37-5ffcf1cad68f service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-626b1219-8f8c-48f8-9e02-40c257ba0536 req-0e6d5a8e-6865-45be-9f37-5ffcf1cad68f service nova] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-626b1219-8f8c-48f8-9e02-40c257ba0536 req-0e6d5a8e-6865-45be-9f37-5ffcf1cad68f service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-626b1219-8f8c-48f8-9e02-40c257ba0536 req-0e6d5a8e-6865-45be-9f37-5ffcf1cad68f service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:57 user nova-compute[74889]: DEBUG nova.compute.manager [req-626b1219-8f8c-48f8-9e02-40c257ba0536 req-0e6d5a8e-6865-45be-9f37-5ffcf1cad68f service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] No waiting events found dispatching network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:57 user nova-compute[74889]: WARNING nova.compute.manager [req-626b1219-8f8c-48f8-9e02-40c257ba0536 req-0e6d5a8e-6865-45be-9f37-5ffcf1cad68f service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received unexpected event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 for instance with vm_state building and task_state spawning.
Nov 10 12:00:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:00:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Instance spawned successfully.
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:00:59 user nova-compute[74889]: INFO nova.compute.manager [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-f53d02f6-837a-4d6e-8484-c42b88d369b4 req-af85e6f3-34aa-41a2-8a7a-79b58fe09b90 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f53d02f6-837a-4d6e-8484-c42b88d369b4 req-af85e6f3-34aa-41a2-8a7a-79b58fe09b90 service nova] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f53d02f6-837a-4d6e-8484-c42b88d369b4 req-af85e6f3-34aa-41a2-8a7a-79b58fe09b90 service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f53d02f6-837a-4d6e-8484-c42b88d369b4 req-af85e6f3-34aa-41a2-8a7a-79b58fe09b90 service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:00:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-f53d02f6-837a-4d6e-8484-c42b88d369b4 req-af85e6f3-34aa-41a2-8a7a-79b58fe09b90 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] No waiting events found dispatching network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:00:59 user nova-compute[74889]: WARNING nova.compute.manager [req-f53d02f6-837a-4d6e-8484-c42b88d369b4 req-af85e6f3-34aa-41a2-8a7a-79b58fe09b90 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received unexpected event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 for instance with vm_state building and task_state spawning.
Nov 10 12:00:59 user nova-compute[74889]: INFO nova.compute.manager [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Took 6.11 seconds to build instance.
Nov 10 12:00:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cb129ff-2b8a-4927-b51a-0c7439499305 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.220s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:06 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 is timed out.
Nov 10 12:01:06 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Successfully detached device vdb from instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 from the live domain config.
Nov 10 12:01:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ksNROXwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:01:06 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe2d36e-19e4-4c72-8bd4-229efa38cd06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:01:06 user nova-compute[74889]: No targets found.
Nov 10 12:01:06 user nova-compute[74889]: iSNS:
Nov 10 12:01:06 user nova-compute[74889]: No targets found.
Nov 10 12:01:06 user nova-compute[74889]: STATIC:
Nov 10 12:01:06 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e
Nov 10 12:01:06 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:01:06 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:01:06 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d
Nov 10 12:01:06 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:01:06 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:01:06 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad
Nov 10 12:01:06 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:01:06 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:01:06 user nova-compute[74889]: FIRMWARE:
Nov 10 12:01:06 user nova-compute[74889]: No targets found.
Nov 10 12:01:06 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:01:06 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:01:06 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b76f5b7-7ad8-44a6-84e2-c790cf69b611]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ead6c5a-4623-4dec-a88b-053f294102d7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:01:06 user nova-compute[74889]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)
Nov 10 12:01:06 user nova-compute[74889]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:01:06 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:01:06 user nova-compute[74889]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e (non-flash)
Nov 10 12:01:06 user nova-compute[74889]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:01:06 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a27e1630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07822eb-8a99-4f9e-80ad-e1cd30ebb9af]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b76054-e0eb-433e-97f4-d5b5ad033c9d]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[440f5833-c3c8-4e6b-b719-8bd6578ff4ce]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e904d847-805d-4135-9cab-e0538602ac59]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[38667619-fc6e-4aa7-951a-cfb618dee930]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[67617fd3-6f1c-4cfd-a064-bb116845a78f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e, portal: 172.16.0.220,3260]
Nov 10 12:01:06 user nova-compute[74889]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e, portal: 172.16.0.220,3260] successful.
Nov 10 12:01:06 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:551451c4-b37e-4973-9bf3-87f6bea4ce0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb6c1f0-c423-4691-9a3d-5cc95528b6b2]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] <== disconnect_volume: return (305ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:01:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:01:07 user nova-compute[74889]: DEBUG nova.objects.instance [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lazy-loading 'flavor' on Instance uuid d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:01:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e77f9bf-5ee6-47fa-99a5-ef19f6496e8e tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.027s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "interface-d6a0ffdd-1c72-4a34-b652-d14a01965ad5-b97913e7-3fad-42b9-8464-3e045a5d9f95" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "interface-d6a0ffdd-1c72-4a34-b652-d14a01965ad5-b97913e7-3fad-42b9-8464-3e045a5d9f95" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.objects.instance [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lazy-loading 'flavor' on Instance uuid d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021355343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021355343',id=15,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0vequKP+K5HhXnSZEekp/UTgizqm44CF7EwBTHzQ3YrW5/0KlwgVsmqJxdfyDOzcFvmhjOI1nY67HVgkbNSp+Wusi+soHfSh0U5hG8mvTVgzxbmEuelIU3LcM+ZQt2JQ==',key_name='tempest-keypair-1815934162',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:58:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfc5c65f3ec4fedb9b968e20399aeab',ramdisk_id='',reservation_id='r-sc38cubd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-866426842',owner_user_name='tempest-TaggedAttachmentsTest-866426842-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f9a0d401cc4f53b97396ec66e5ac69',uuid=d6a0ffdd-1c72-4a34-b652-d14a01965ad5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converting VIF {"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:f1:48"/><model type="virtio"/><mtu size="1442"/><target dev="tapb97913e7-3f"/></interface> {{(pid=74889) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:f1:48"/><model type="virtio"/><mtu size="1442"/><target dev="tapb97913e7-3f"/></interface> {{(pid=74889) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Attempting to detach device tapb97913e7-3f from instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] detach device xml: <interface type="ethernet">
Nov 10 12:01:08 user nova-compute[74889]:   <mac address="fa:16:3e:eb:f1:48"/>
Nov 10 12:01:08 user nova-compute[74889]:   <model type="virtio"/>
Nov 10 12:01:08 user nova-compute[74889]:   <mtu size="1442"/>
Nov 10 12:01:08 user nova-compute[74889]:   <target dev="tapb97913e7-3f"/>
Nov 10 12:01:08 user nova-compute[74889]: </interface>
Nov 10 12:01:08 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:f1:48"/><model type="virtio"/><mtu size="1442"/><target dev="tapb97913e7-3f"/></interface> {{(pid=74889) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:eb:f1:48"/><model type="virtio"/><mtu size="1442"/><target dev="tapb97913e7-3f"/></interface>not found in domain: <domain type='kvm' id='18'>
Nov 10 12:01:08 user nova-compute[74889]:   <name>instance-0000000f</name>
Nov 10 12:01:08 user nova-compute[74889]:   <uuid>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</uuid>
Nov 10 12:01:08 user nova-compute[74889]:   <metadata>
Nov 10 12:01:08 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:01:08 user nova-compute[74889]:   <nova:package version="0.0.0"/>
Nov 10 12:01:08 user nova-compute[74889]:   <nova:name>tempest-device-tagging-server-2021355343</nova:name>
Nov 10 12:01:08 user nova-compute[74889]:   <nova:creationTime>2023-11-10 12:00:15</nova:creationTime>
Nov 10 12:01:08 user nova-compute[74889]:   <nova:flavor name="m1.tiny">
Nov 10 12:01:08 user nova-compute[74889]:     <nova:memory>512</nova:memory>
Nov 10 12:01:08 user nova-compute[74889]:     <nova:disk>1</nova:disk>
Nov 10 12:01:08 user nova-compute[74889]:     <nova:swap>0</nova:swap>
Nov 10 12:01:08 user nova-compute[74889]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:01:08 user nova-compute[74889]:     <nova:vcpus>1</nova:vcpus>
Nov 10 12:01:08 user nova-compute[74889]:   </nova:flavor>
Nov 10 12:01:08 user nova-compute[74889]:   <nova:owner>
Nov 10 12:01:08 user nova-compute[74889]:     <nova:user uuid="d9f9a0d401cc4f53b97396ec66e5ac69">tempest-TaggedAttachmentsTest-866426842-project-member</nova:user>
Nov 10 12:01:08 user nova-compute[74889]:     <nova:project uuid="9bfc5c65f3ec4fedb9b968e20399aeab">tempest-TaggedAttachmentsTest-866426842</nova:project>
Nov 10 12:01:08 user nova-compute[74889]:   </nova:owner>
Nov 10 12:01:08 user nova-compute[74889]:   <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:01:08 user nova-compute[74889]:   <nova:ports>
Nov 10 12:01:08 user nova-compute[74889]:     <nova:port uuid="9616e5e2-f3ec-455f-b303-9dd4bede6596">
Nov 10 12:01:08 user nova-compute[74889]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:01:08 user nova-compute[74889]:     </nova:port>
Nov 10 12:01:08 user nova-compute[74889]:     <nova:port uuid="b97913e7-3fad-42b9-8464-3e045a5d9f95">
Nov 10 12:01:08 user nova-compute[74889]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Nov 10 12:01:08 user nova-compute[74889]:     </nova:port>
Nov 10 12:01:08 user nova-compute[74889]:   </nova:ports>
Nov 10 12:01:08 user nova-compute[74889]: </nova:instance>
Nov 10 12:01:08 user nova-compute[74889]:   </metadata>
Nov 10 12:01:08 user nova-compute[74889]:   <memory unit='KiB'>524288</memory>
Nov 10 12:01:08 user nova-compute[74889]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 12:01:08 user nova-compute[74889]:   <vcpu placement='static'>1</vcpu>
Nov 10 12:01:08 user nova-compute[74889]:   <resource>
Nov 10 12:01:08 user nova-compute[74889]:     <partition>/machine</partition>
Nov 10 12:01:08 user nova-compute[74889]:   </resource>
Nov 10 12:01:08 user nova-compute[74889]:   <sysinfo type='smbios'>
Nov 10 12:01:08 user nova-compute[74889]:     <system>
Nov 10 12:01:08 user nova-compute[74889]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 12:01:08 user nova-compute[74889]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 12:01:08 user nova-compute[74889]:       <entry name='version'>0.0.0</entry>
Nov 10 12:01:08 user nova-compute[74889]:       <entry name='serial'>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</entry>
Nov 10 12:01:08 user nova-compute[74889]:       <entry name='uuid'>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</entry>
Nov 10 12:01:08 user nova-compute[74889]:       <entry name='family'>Virtual Machine</entry>
Nov 10 12:01:08 user nova-compute[74889]:     </system>
Nov 10 12:01:08 user nova-compute[74889]:   </sysinfo>
Nov 10 12:01:08 user nova-compute[74889]:   <os>
Nov 10 12:01:08 user nova-compute[74889]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 12:01:08 user nova-compute[74889]:     <boot dev='hd'/>
Nov 10 12:01:08 user nova-compute[74889]:     <smbios mode='sysinfo'/>
Nov 10 12:01:08 user nova-compute[74889]:   </os>
Nov 10 12:01:08 user nova-compute[74889]:   <features>
Nov 10 12:01:08 user nova-compute[74889]:     <acpi/>
Nov 10 12:01:08 user nova-compute[74889]:     <apic/>
Nov 10 12:01:08 user nova-compute[74889]:     <vmcoreinfo state='on'/>
Nov 10 12:01:08 user nova-compute[74889]:   </features>
Nov 10 12:01:08 user nova-compute[74889]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 12:01:08 user nova-compute[74889]:     <model fallback='forbid'>Nehalem</model>
Nov 10 12:01:08 user nova-compute[74889]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 12:01:08 user nova-compute[74889]:     <feature policy='require' name='vme'/>
Nov 10 12:01:08 user nova-compute[74889]:     <feature policy='require' name='x2apic'/>
Nov 10 12:01:08 user nova-compute[74889]:     <feature policy='require' name='hypervisor'/>
Nov 10 12:01:08 user nova-compute[74889]:   </cpu>
Nov 10 12:01:08 user nova-compute[74889]:   <clock offset='utc'>
Nov 10 12:01:08 user nova-compute[74889]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 12:01:08 user nova-compute[74889]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 12:01:08 user nova-compute[74889]:     <timer name='hpet' present='no'/>
Nov 10 12:01:08 user nova-compute[74889]:   </clock>
Nov 10 12:01:08 user nova-compute[74889]:   <on_poweroff>destroy</on_poweroff>
Nov 10 12:01:08 user nova-compute[74889]:   <on_reboot>restart</on_reboot>
Nov 10 12:01:08 user nova-compute[74889]:   <on_crash>destroy</on_crash>
Nov 10 12:01:08 user nova-compute[74889]:   <devices>
Nov 10 12:01:08 user nova-compute[74889]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 12:01:08 user nova-compute[74889]:     <disk type='file' device='disk'>
Nov 10 12:01:08 user nova-compute[74889]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 12:01:08 user nova-compute[74889]:       <source file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk' index='2'/>
Nov 10 12:01:08 user nova-compute[74889]:       <backingStore type='file' index='3'>
Nov 10 12:01:08 user nova-compute[74889]:         <format type='raw'/>
Nov 10 12:01:08 user nova-compute[74889]:         <source file='/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a'/>
Nov 10 12:01:08 user nova-compute[74889]:         <backingStore/>
Nov 10 12:01:08 user nova-compute[74889]:       </backingStore>
Nov 10 12:01:08 user nova-compute[74889]:       <target dev='vda' bus='virtio'/>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='virtio-disk0'/>
Nov 10 12:01:08 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </disk>
Nov 10 12:01:08 user nova-compute[74889]:     <disk type='file' device='cdrom'>
Nov 10 12:01:08 user nova-compute[74889]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 12:01:08 user nova-compute[74889]:       <source file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.config' index='1'/>
Nov 10 12:01:08 user nova-compute[74889]:       <backingStore/>
Nov 10 12:01:08 user nova-compute[74889]:       <target dev='hda' bus='ide'/>
Nov 10 12:01:08 user nova-compute[74889]:       <readonly/>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='ide0-0-0'/>
Nov 10 12:01:08 user nova-compute[74889]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </disk>
Nov 10 12:01:08 user nova-compute[74889]:     <controller type='usb' index='0' model='none'>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='usb'/>
Nov 10 12:01:08 user nova-compute[74889]:     </controller>
Nov 10 12:01:08 user nova-compute[74889]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='pci.0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </controller>
Nov 10 12:01:08 user nova-compute[74889]:     <controller type='ide' index='0'>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='ide'/>
Nov 10 12:01:08 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 12:01:08 user nova-compute[74889]:     </controller>
Nov 10 12:01:08 user nova-compute[74889]:     <interface type='ethernet'>
Nov 10 12:01:08 user nova-compute[74889]:       <mac address='fa:16:3e:34:c5:6e'/>
Nov 10 12:01:08 user nova-compute[74889]:       <target dev='tap9616e5e2-f3'/>
Nov 10 12:01:08 user nova-compute[74889]:       <model type='virtio'/>
Nov 10 12:01:08 user nova-compute[74889]:       <mtu size='1442'/>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='net0'/>
Nov 10 12:01:08 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </interface>
Nov 10 12:01:08 user nova-compute[74889]:     <interface type='ethernet'>
Nov 10 12:01:08 user nova-compute[74889]:       <mac address='fa:16:3e:eb:f1:48'/>
Nov 10 12:01:08 user nova-compute[74889]:       <target dev='tapb97913e7-3f'/>
Nov 10 12:01:08 user nova-compute[74889]:       <model type='virtio'/>
Nov 10 12:01:08 user nova-compute[74889]:       <mtu size='1442'/>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='net1'/>
Nov 10 12:01:08 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </interface>
Nov 10 12:01:08 user nova-compute[74889]:     <serial type='pty'>
Nov 10 12:01:08 user nova-compute[74889]:       <source path='/dev/pts/7'/>
Nov 10 12:01:08 user nova-compute[74889]:       <log file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/console.log' append='off'/>
Nov 10 12:01:08 user nova-compute[74889]:       <target type='isa-serial' port='0'>
Nov 10 12:01:08 user nova-compute[74889]:         <model name='isa-serial'/>
Nov 10 12:01:08 user nova-compute[74889]:       </target>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='serial0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </serial>
Nov 10 12:01:08 user nova-compute[74889]:     <console type='pty' tty='/dev/pts/7'>
Nov 10 12:01:08 user nova-compute[74889]:       <source path='/dev/pts/7'/>
Nov 10 12:01:08 user nova-compute[74889]:       <log file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/console.log' append='off'/>
Nov 10 12:01:08 user nova-compute[74889]:       <target type='serial' port='0'/>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='serial0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </console>
Nov 10 12:01:08 user nova-compute[74889]:     <input type='mouse' bus='ps2'>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='input0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </input>
Nov 10 12:01:08 user nova-compute[74889]:     <input type='keyboard' bus='ps2'>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='input1'/>
Nov 10 12:01:08 user nova-compute[74889]:     </input>
Nov 10 12:01:08 user nova-compute[74889]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 10 12:01:08 user nova-compute[74889]:       <listen type='address' address='0.0.0.0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </graphics>
Nov 10 12:01:08 user nova-compute[74889]:     <audio id='1' type='none'/>
Nov 10 12:01:08 user nova-compute[74889]:     <video>
Nov 10 12:01:08 user nova-compute[74889]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='video0'/>
Nov 10 12:01:08 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </video>
Nov 10 12:01:08 user nova-compute[74889]:     <memballoon model='virtio'>
Nov 10 12:01:08 user nova-compute[74889]:       <stats period='10'/>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='balloon0'/>
Nov 10 12:01:08 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </memballoon>
Nov 10 12:01:08 user nova-compute[74889]:     <rng model='virtio'>
Nov 10 12:01:08 user nova-compute[74889]:       <backend model='random'>/dev/urandom</backend>
Nov 10 12:01:08 user nova-compute[74889]:       <alias name='rng0'/>
Nov 10 12:01:08 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 12:01:08 user nova-compute[74889]:     </rng>
Nov 10 12:01:08 user nova-compute[74889]:   </devices>
Nov 10 12:01:08 user nova-compute[74889]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 12:01:08 user nova-compute[74889]:     <label>libvirt-d6a0ffdd-1c72-4a34-b652-d14a01965ad5</label>
Nov 10 12:01:08 user nova-compute[74889]:     <imagelabel>libvirt-d6a0ffdd-1c72-4a34-b652-d14a01965ad5</imagelabel>
Nov 10 12:01:08 user nova-compute[74889]:   </seclabel>
Nov 10 12:01:08 user nova-compute[74889]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 12:01:08 user nova-compute[74889]:     <label>+64055:+108</label>
Nov 10 12:01:08 user nova-compute[74889]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 12:01:08 user nova-compute[74889]:   </seclabel>
Nov 10 12:01:08 user nova-compute[74889]: </domain>
Nov 10 12:01:08 user nova-compute[74889]:  {{(pid=74889) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 12:01:08 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Successfully detached device tapb97913e7-3f from instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 from the persistent domain config.
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] (1/8): Attempting to detach device tapb97913e7-3f with device alias net1 from instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] detach device xml: <interface type="ethernet">
Nov 10 12:01:08 user nova-compute[74889]:   <mac address="fa:16:3e:eb:f1:48"/>
Nov 10 12:01:08 user nova-compute[74889]:   <model type="virtio"/>
Nov 10 12:01:08 user nova-compute[74889]:   <mtu size="1442"/>
Nov 10 12:01:08 user nova-compute[74889]:   <target dev="tapb97913e7-3f"/>
Nov 10 12:01:08 user nova-compute[74889]: </interface>
Nov 10 12:01:08 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Start waiting for the detach event from libvirt for device tapb97913e7-3f with device alias net1 for instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-511cc946-083f-4245-a1f4-0ccd2230a31d req-024655bc-8631-4ff6-b140-0c7835d453e7 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-unplugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-511cc946-083f-4245-a1f4-0ccd2230a31d req-024655bc-8631-4ff6-b140-0c7835d453e7 service nova] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-511cc946-083f-4245-a1f4-0ccd2230a31d req-024655bc-8631-4ff6-b140-0c7835d453e7 service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-511cc946-083f-4245-a1f4-0ccd2230a31d req-024655bc-8631-4ff6-b140-0c7835d453e7 service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-511cc946-083f-4245-a1f4-0ccd2230a31d req-024655bc-8631-4ff6-b140-0c7835d453e7 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] No waiting events found dispatching network-vif-unplugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:08 user nova-compute[74889]: WARNING nova.compute.manager [req-511cc946-083f-4245-a1f4-0ccd2230a31d req-024655bc-8631-4ff6-b140-0c7835d453e7 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received unexpected event network-vif-unplugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 for instance with vm_state active and task_state None.
Nov 10 12:01:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:09 user nova-compute[74889]: DEBUG nova.compute.manager [req-047375e7-fac9-4c5e-a3da-db2dfb604a66 req-650a1ad3-54fa-4d38-851a-98314a3c1675 service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received event network-changed-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:09 user nova-compute[74889]: DEBUG nova.compute.manager [req-047375e7-fac9-4c5e-a3da-db2dfb604a66 req-650a1ad3-54fa-4d38-851a-98314a3c1675 service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Refreshing instance network info cache due to event network-changed-64d5dc91-1a08-49c0-919e-d12b925316be. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:01:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-047375e7-fac9-4c5e-a3da-db2dfb604a66 req-650a1ad3-54fa-4d38-851a-98314a3c1675 service nova] Acquiring lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:01:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-047375e7-fac9-4c5e-a3da-db2dfb604a66 req-650a1ad3-54fa-4d38-851a-98314a3c1675 service nova] Acquired lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:01:09 user nova-compute[74889]: DEBUG nova.network.neutron [req-047375e7-fac9-4c5e-a3da-db2dfb604a66 req-650a1ad3-54fa-4d38-851a-98314a3c1675 service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Refreshing network info cache for port 64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:01:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "fc53bac7-d79d-4c33-af61-340b00dd8758" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:09 user nova-compute[74889]: INFO nova.compute.manager [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Terminating instance
Nov 10 12:01:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.network.neutron [req-047375e7-fac9-4c5e-a3da-db2dfb604a66 req-650a1ad3-54fa-4d38-851a-98314a3c1675 service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Updated VIF entry in instance network info cache for port 64d5dc91-1a08-49c0-919e-d12b925316be. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.network.neutron [req-047375e7-fac9-4c5e-a3da-db2dfb604a66 req-650a1ad3-54fa-4d38-851a-98314a3c1675 service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Updating instance_info_cache with network_info: [{"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-047375e7-fac9-4c5e-a3da-db2dfb604a66 req-650a1ad3-54fa-4d38-851a-98314a3c1675 service nova] Releasing lock "refresh_cache-fc53bac7-d79d-4c33-af61-340b00dd8758" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Instance destroyed successfully.
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.objects.instance [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lazy-loading 'resources' on Instance uuid fc53bac7-d79d-4c33-af61-340b00dd8758 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-168257770',display_name='tempest-TestStampPattern-server-168257770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-168257770',id=14,image_ref='ea9a6918-741c-4f96-ab81-aef1ad6789c3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxDwFs0AGsEtr15Zi6x2wsIDGQYgbiQSBAGO7YjoF8bCXJVpt9lKEMaMnjKkVdYpvjgsEv3fRCgW9Gc/EdEP0DEjX5Wcf4b9A5MJqJw73kiAjUo/ElWA2D+2WH2oMrVxQ==',key_name='tempest-TestStampPattern-81644911',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:58:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cde601a6b8e24d988c49013a8fe6f0fb',ramdisk_id='',reservation_id='r-cm370ddd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6200554d-5be6-48b4-90e9-4151006d8ce3',image_min_disk='1',image_min_ram='0',image_owner_id='cde601a6b8e24d988c49013a8fe6f0fb',image_owner_project_name='tempest-TestStampPattern-1182113080',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1182113080-project-member',image_user_id='0713f019fd484ce58496c9038295dad3',owner_project_name='tempest-TestStampPattern-1182113080',owner_user_name='tempest-TestStampPattern-1182113080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:58:05Z,user_data=None,user_id='0713f019fd484ce58496c9038295dad3',uuid=fc53bac7-d79d-4c33-af61-340b00dd8758,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converting VIF {"id": "64d5dc91-1a08-49c0-919e-d12b925316be", "address": "fa:16:3e:b5:58:ad", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64d5dc91-1a", "ovs_interfaceid": "64d5dc91-1a08-49c0-919e-d12b925316be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:58:ad,bridge_name='br-int',has_traffic_filtering=True,id=64d5dc91-1a08-49c0-919e-d12b925316be,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d5dc91-1a') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG os_vif [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:58:ad,bridge_name='br-int',has_traffic_filtering=True,id=64d5dc91-1a08-49c0-919e-d12b925316be,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d5dc91-1a') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64d5dc91-1a, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f70a1e01-9712-456a-940f-6a989f1332ad) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:10 user nova-compute[74889]: INFO os_vif [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:58:ad,bridge_name='br-int',has_traffic_filtering=True,id=64d5dc91-1a08-49c0-919e-d12b925316be,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64d5dc91-1a')
Nov 10 12:01:10 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Deleting instance files /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758_del
Nov 10 12:01:10 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Deletion of /opt/stack/data/nova/instances/fc53bac7-d79d-4c33-af61-340b00dd8758_del complete
Nov 10 12:01:10 user nova-compute[74889]: INFO nova.compute.manager [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-plugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] No waiting events found dispatching network-vif-plugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:10 user nova-compute[74889]: WARNING nova.compute.manager [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received unexpected event network-vif-plugged-b97913e7-3fad-42b9-8464-3e045a5d9f95 for instance with vm_state active and task_state None.
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received event network-vif-unplugged-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] Acquiring lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] No waiting events found dispatching network-vif-unplugged-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received event network-vif-unplugged-64d5dc91-1a08-49c0-919e-d12b925316be for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received event network-vif-plugged-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] Acquiring lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] No waiting events found dispatching network-vif-plugged-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:10 user nova-compute[74889]: WARNING nova.compute.manager [req-c23b9b78-239f-4775-b2a4-ac039199fe96 req-f2628687-8c8a-4332-8e40-f7e7e430019a service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received unexpected event network-vif-plugged-64d5dc91-1a08-49c0-919e-d12b925316be for instance with vm_state active and task_state deleting.
Nov 10 12:01:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:11 user nova-compute[74889]: INFO nova.compute.manager [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Terminating instance
Nov 10 12:01:11 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:11 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Took 0.90 seconds to deallocate network for instance.
Nov 10 12:01:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-0c7a4591-7630-4d08-a52a-370e12d12780 req-2946194c-d084-4c38-8359-1f1ed23befdb service nova] [instance: fc53bac7-d79d-4c33-af61-340b00dd8758] Received event network-vif-deleted-64d5dc91-1a08-49c0-919e-d12b925316be {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:11 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Instance destroyed successfully.
Nov 10 12:01:11 user nova-compute[74889]: DEBUG nova.objects.instance [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lazy-loading 'resources' on Instance uuid 81cfb431-3aee-4081-82ba-49612a294d61 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:54:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1580238869',display_name='tempest-TestServerVolumeAttachmentScenario-server-1580238869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1580238869',id=10,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2a2SxXxtm+bAy8TOYYaRgwy+jfq0jWYq90NIymi6yqSUOJGG5OsmLYXVuQ0c9Aggyup1dZlDIA8zMDtEGJ7+7J9WM5+1hCEfAP0a1dQr385EFFgxw5Y5zcG8lN/X8cwg==',key_name='tempest-keypair-532379226',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:54:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e233f699d30349eeac9c998bca441273',ramdisk_id='',reservation_id='r-rc3vfi6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-22575309',owner_user_name='tempest-TestServerVolumeAttachmentScenario-22575309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:54:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f688fe301af64abfad9a6750035f27bc',uuid=81cfb431-3aee-4081-82ba-49612a294d61,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Converting VIF {"id": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "address": "fa:16:3e:f4:9b:09", "network": {"id": "9f5143ba-a259-4cc8-be9c-c8f254c1ca7f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2094347048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e233f699d30349eeac9c998bca441273", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc63694e5-be", "ovs_interfaceid": "c63694e5-beaf-49f0-9dab-7bde0d79d1ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:9b:09,bridge_name='br-int',has_traffic_filtering=True,id=c63694e5-beaf-49f0-9dab-7bde0d79d1ad,network=Network(9f5143ba-a259-4cc8-be9c-c8f254c1ca7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63694e5-be') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG os_vif [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:9b:09,bridge_name='br-int',has_traffic_filtering=True,id=c63694e5-beaf-49f0-9dab-7bde0d79d1ad,network=Network(9f5143ba-a259-4cc8-be9c-c8f254c1ca7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63694e5-be') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc63694e5-be, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f63f1e6-b8cd-40aa-b8da-6cbe9e738a0f) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:01:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:11 user nova-compute[74889]: INFO os_vif [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:9b:09,bridge_name='br-int',has_traffic_filtering=True,id=c63694e5-beaf-49f0-9dab-7bde0d79d1ad,network=Network(9f5143ba-a259-4cc8-be9c-c8f254c1ca7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc63694e5-be')
Nov 10 12:01:11 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Deleting instance files /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61_del
Nov 10 12:01:11 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Deletion of /opt/stack/data/nova/instances/81cfb431-3aee-4081-82ba-49612a294d61_del complete
Nov 10 12:01:12 user nova-compute[74889]: INFO nova.compute.manager [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 10 12:01:12 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:12 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Deleted allocations for instance fc53bac7-d79d-4c33-af61-340b00dd8758
Nov 10 12:01:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32294cfe-e9dd-453b-bdbd-ed9def9545ac tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "fc53bac7-d79d-4c33-af61-340b00dd8758" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.427s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received event network-vif-unplugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] Lock "81cfb431-3aee-4081-82ba-49612a294d61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] Lock "81cfb431-3aee-4081-82ba-49612a294d61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] No waiting events found dispatching network-vif-unplugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received event network-vif-unplugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received event network-vif-plugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] Acquiring lock "81cfb431-3aee-4081-82ba-49612a294d61-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] Lock "81cfb431-3aee-4081-82ba-49612a294d61-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] Lock "81cfb431-3aee-4081-82ba-49612a294d61-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] No waiting events found dispatching network-vif-plugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:12 user nova-compute[74889]: WARNING nova.compute.manager [req-d99fc6b5-4aec-40c3-9293-703bb42fa9d0 req-1f461c3d-3c35-4003-9d16-adcd33a1366d service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received unexpected event network-vif-plugged-c63694e5-beaf-49f0-9dab-7bde0d79d1ad for instance with vm_state active and task_state deleting.
Nov 10 12:01:13 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:13 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Took 0.98 seconds to deallocate network for instance.
Nov 10 12:01:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:13 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:01:13 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:01:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:13 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Deleted allocations for instance 81cfb431-3aee-4081-82ba-49612a294d61
Nov 10 12:01:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fcd1c8a2-642b-41ec-a172-99fa312dcaa0 tempest-TestServerVolumeAttachmentScenario-22575309 tempest-TestServerVolumeAttachmentScenario-22575309-project-member] Lock "81cfb431-3aee-4081-82ba-49612a294d61" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-d2618440-3323-41f6-995a-c362fae10d43 req-85e07e0d-91ac-4ca8-b4bc-3127e1c88146 service nova] [instance: 81cfb431-3aee-4081-82ba-49612a294d61] Received event network-vif-deleted-c63694e5-beaf-49f0-9dab-7bde0d79d1ad {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:28 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Waiting for libvirt event about the detach of device tapb97913e7-3f with device alias net1 from instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 is timed out.
Nov 10 12:01:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:f1:48"/><model type="virtio"/><mtu size="1442"/><target dev="tapb97913e7-3f"/></interface> {{(pid=74889) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:eb:f1:48"/><model type="virtio"/><mtu size="1442"/><target dev="tapb97913e7-3f"/></interface>not found in domain: <domain type='kvm' id='18'>
Nov 10 12:01:28 user nova-compute[74889]:   <name>instance-0000000f</name>
Nov 10 12:01:28 user nova-compute[74889]:   <uuid>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</uuid>
Nov 10 12:01:28 user nova-compute[74889]:   <metadata>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:01:28 user nova-compute[74889]:   <nova:package version="0.0.0"/>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:name>tempest-device-tagging-server-2021355343</nova:name>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:creationTime>2023-11-10 12:00:15</nova:creationTime>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:flavor name="m1.tiny">
Nov 10 12:01:28 user nova-compute[74889]:     <nova:memory>512</nova:memory>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:disk>1</nova:disk>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:swap>0</nova:swap>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:vcpus>1</nova:vcpus>
Nov 10 12:01:28 user nova-compute[74889]:   </nova:flavor>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:owner>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:user uuid="d9f9a0d401cc4f53b97396ec66e5ac69">tempest-TaggedAttachmentsTest-866426842-project-member</nova:user>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:project uuid="9bfc5c65f3ec4fedb9b968e20399aeab">tempest-TaggedAttachmentsTest-866426842</nova:project>
Nov 10 12:01:28 user nova-compute[74889]:   </nova:owner>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:ports>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:port uuid="9616e5e2-f3ec-455f-b303-9dd4bede6596">
Nov 10 12:01:28 user nova-compute[74889]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:01:28 user nova-compute[74889]:     </nova:port>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:port uuid="b97913e7-3fad-42b9-8464-3e045a5d9f95">
Nov 10 12:01:28 user nova-compute[74889]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Nov 10 12:01:28 user nova-compute[74889]:     </nova:port>
Nov 10 12:01:28 user nova-compute[74889]:   </nova:ports>
Nov 10 12:01:28 user nova-compute[74889]: </nova:instance>
Nov 10 12:01:28 user nova-compute[74889]:   </metadata>
Nov 10 12:01:28 user nova-compute[74889]:   <memory unit='KiB'>524288</memory>
Nov 10 12:01:28 user nova-compute[74889]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 12:01:28 user nova-compute[74889]:   <vcpu placement='static'>1</vcpu>
Nov 10 12:01:28 user nova-compute[74889]:   <resource>
Nov 10 12:01:28 user nova-compute[74889]:     <partition>/machine</partition>
Nov 10 12:01:28 user nova-compute[74889]:   </resource>
Nov 10 12:01:28 user nova-compute[74889]:   <sysinfo type='smbios'>
Nov 10 12:01:28 user nova-compute[74889]:     <system>
Nov 10 12:01:28 user nova-compute[74889]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 12:01:28 user nova-compute[74889]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 12:01:28 user nova-compute[74889]:       <entry name='version'>0.0.0</entry>
Nov 10 12:01:28 user nova-compute[74889]:       <entry name='serial'>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</entry>
Nov 10 12:01:28 user nova-compute[74889]:       <entry name='uuid'>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</entry>
Nov 10 12:01:28 user nova-compute[74889]:       <entry name='family'>Virtual Machine</entry>
Nov 10 12:01:28 user nova-compute[74889]:     </system>
Nov 10 12:01:28 user nova-compute[74889]:   </sysinfo>
Nov 10 12:01:28 user nova-compute[74889]:   <os>
Nov 10 12:01:28 user nova-compute[74889]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 12:01:28 user nova-compute[74889]:     <boot dev='hd'/>
Nov 10 12:01:28 user nova-compute[74889]:     <smbios mode='sysinfo'/>
Nov 10 12:01:28 user nova-compute[74889]:   </os>
Nov 10 12:01:28 user nova-compute[74889]:   <features>
Nov 10 12:01:28 user nova-compute[74889]:     <acpi/>
Nov 10 12:01:28 user nova-compute[74889]:     <apic/>
Nov 10 12:01:28 user nova-compute[74889]:     <vmcoreinfo state='on'/>
Nov 10 12:01:28 user nova-compute[74889]:   </features>
Nov 10 12:01:28 user nova-compute[74889]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 12:01:28 user nova-compute[74889]:     <model fallback='forbid'>Nehalem</model>
Nov 10 12:01:28 user nova-compute[74889]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 12:01:28 user nova-compute[74889]:     <feature policy='require' name='vme'/>
Nov 10 12:01:28 user nova-compute[74889]:     <feature policy='require' name='x2apic'/>
Nov 10 12:01:28 user nova-compute[74889]:     <feature policy='require' name='hypervisor'/>
Nov 10 12:01:28 user nova-compute[74889]:   </cpu>
Nov 10 12:01:28 user nova-compute[74889]:   <clock offset='utc'>
Nov 10 12:01:28 user nova-compute[74889]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 12:01:28 user nova-compute[74889]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 12:01:28 user nova-compute[74889]:     <timer name='hpet' present='no'/>
Nov 10 12:01:28 user nova-compute[74889]:   </clock>
Nov 10 12:01:28 user nova-compute[74889]:   <on_poweroff>destroy</on_poweroff>
Nov 10 12:01:28 user nova-compute[74889]:   <on_reboot>restart</on_reboot>
Nov 10 12:01:28 user nova-compute[74889]:   <on_crash>destroy</on_crash>
Nov 10 12:01:28 user nova-compute[74889]:   <devices>
Nov 10 12:01:28 user nova-compute[74889]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 12:01:28 user nova-compute[74889]:     <disk type='file' device='disk'>
Nov 10 12:01:28 user nova-compute[74889]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 12:01:28 user nova-compute[74889]:       <source file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk' index='2'/>
Nov 10 12:01:28 user nova-compute[74889]:       <backingStore type='file' index='3'>
Nov 10 12:01:28 user nova-compute[74889]:         <format type='raw'/>
Nov 10 12:01:28 user nova-compute[74889]:         <source file='/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a'/>
Nov 10 12:01:28 user nova-compute[74889]:         <backingStore/>
Nov 10 12:01:28 user nova-compute[74889]:       </backingStore>
Nov 10 12:01:28 user nova-compute[74889]:       <target dev='vda' bus='virtio'/>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='virtio-disk0'/>
Nov 10 12:01:28 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </disk>
Nov 10 12:01:28 user nova-compute[74889]:     <disk type='file' device='cdrom'>
Nov 10 12:01:28 user nova-compute[74889]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 12:01:28 user nova-compute[74889]:       <source file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.config' index='1'/>
Nov 10 12:01:28 user nova-compute[74889]:       <backingStore/>
Nov 10 12:01:28 user nova-compute[74889]:       <target dev='hda' bus='ide'/>
Nov 10 12:01:28 user nova-compute[74889]:       <readonly/>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='ide0-0-0'/>
Nov 10 12:01:28 user nova-compute[74889]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </disk>
Nov 10 12:01:28 user nova-compute[74889]:     <controller type='usb' index='0' model='none'>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='usb'/>
Nov 10 12:01:28 user nova-compute[74889]:     </controller>
Nov 10 12:01:28 user nova-compute[74889]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='pci.0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </controller>
Nov 10 12:01:28 user nova-compute[74889]:     <controller type='ide' index='0'>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='ide'/>
Nov 10 12:01:28 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 12:01:28 user nova-compute[74889]:     </controller>
Nov 10 12:01:28 user nova-compute[74889]:     <interface type='ethernet'>
Nov 10 12:01:28 user nova-compute[74889]:       <mac address='fa:16:3e:34:c5:6e'/>
Nov 10 12:01:28 user nova-compute[74889]:       <target dev='tap9616e5e2-f3'/>
Nov 10 12:01:28 user nova-compute[74889]:       <model type='virtio'/>
Nov 10 12:01:28 user nova-compute[74889]:       <mtu size='1442'/>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='net0'/>
Nov 10 12:01:28 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </interface>
Nov 10 12:01:28 user nova-compute[74889]:     <serial type='pty'>
Nov 10 12:01:28 user nova-compute[74889]:       <source path='/dev/pts/7'/>
Nov 10 12:01:28 user nova-compute[74889]:       <log file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/console.log' append='off'/>
Nov 10 12:01:28 user nova-compute[74889]:       <target type='isa-serial' port='0'>
Nov 10 12:01:28 user nova-compute[74889]:         <model name='isa-serial'/>
Nov 10 12:01:28 user nova-compute[74889]:       </target>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='serial0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </serial>
Nov 10 12:01:28 user nova-compute[74889]:     <console type='pty' tty='/dev/pts/7'>
Nov 10 12:01:28 user nova-compute[74889]:       <source path='/dev/pts/7'/>
Nov 10 12:01:28 user nova-compute[74889]:       <log file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/console.log' append='off'/>
Nov 10 12:01:28 user nova-compute[74889]:       <target type='serial' port='0'/>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='serial0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </console>
Nov 10 12:01:28 user nova-compute[74889]:     <input type='mouse' bus='ps2'>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='input0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </input>
Nov 10 12:01:28 user nova-compute[74889]:     <input type='keyboard' bus='ps2'>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='input1'/>
Nov 10 12:01:28 user nova-compute[74889]:     </input>
Nov 10 12:01:28 user nova-compute[74889]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 10 12:01:28 user nova-compute[74889]:       <listen type='address' address='0.0.0.0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </graphics>
Nov 10 12:01:28 user nova-compute[74889]:     <audio id='1' type='none'/>
Nov 10 12:01:28 user nova-compute[74889]:     <video>
Nov 10 12:01:28 user nova-compute[74889]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='video0'/>
Nov 10 12:01:28 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </video>
Nov 10 12:01:28 user nova-compute[74889]:     <memballoon model='virtio'>
Nov 10 12:01:28 user nova-compute[74889]:       <stats period='10'/>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='balloon0'/>
Nov 10 12:01:28 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </memballoon>
Nov 10 12:01:28 user nova-compute[74889]:     <rng model='virtio'>
Nov 10 12:01:28 user nova-compute[74889]:       <backend model='random'>/dev/urandom</backend>
Nov 10 12:01:28 user nova-compute[74889]:       <alias name='rng0'/>
Nov 10 12:01:28 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 12:01:28 user nova-compute[74889]:     </rng>
Nov 10 12:01:28 user nova-compute[74889]:   </devices>
Nov 10 12:01:28 user nova-compute[74889]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 12:01:28 user nova-compute[74889]:     <label>libvirt-d6a0ffdd-1c72-4a34-b652-d14a01965ad5</label>
Nov 10 12:01:28 user nova-compute[74889]:     <imagelabel>libvirt-d6a0ffdd-1c72-4a34-b652-d14a01965ad5</imagelabel>
Nov 10 12:01:28 user nova-compute[74889]:   </seclabel>
Nov 10 12:01:28 user nova-compute[74889]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 12:01:28 user nova-compute[74889]:     <label>+64055:+108</label>
Nov 10 12:01:28 user nova-compute[74889]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 12:01:28 user nova-compute[74889]:   </seclabel>
Nov 10 12:01:28 user nova-compute[74889]: </domain>
Nov 10 12:01:28 user nova-compute[74889]:  {{(pid=74889) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 12:01:28 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Successfully detached device tapb97913e7-3f from instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 from the live domain config.
Nov 10 12:01:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021355343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021355343',id=15,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0vequKP+K5HhXnSZEekp/UTgizqm44CF7EwBTHzQ3YrW5/0KlwgVsmqJxdfyDOzcFvmhjOI1nY67HVgkbNSp+Wusi+soHfSh0U5hG8mvTVgzxbmEuelIU3LcM+ZQt2JQ==',key_name='tempest-keypair-1815934162',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:58:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfc5c65f3ec4fedb9b968e20399aeab',ramdisk_id='',reservation_id='r-sc38cubd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-866426842',owner_user_name='tempest-TaggedAttachmentsTest-866426842-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f9a0d401cc4f53b97396ec66e5ac69',uuid=d6a0ffdd-1c72-4a34-b652-d14a01965ad5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converting VIF {"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG os_vif [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb97913e7-3f, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a65a14b-82e4-4d00-acb5-576d5a7d49df) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:28 user nova-compute[74889]: INFO os_vif [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f')
Nov 10 12:01:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:01:28 user nova-compute[74889]:   <nova:package version="0.0.0"/>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:name>tempest-device-tagging-server-2021355343</nova:name>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:creationTime>2023-11-10 12:01:28</nova:creationTime>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:flavor name="m1.tiny">
Nov 10 12:01:28 user nova-compute[74889]:     <nova:memory>512</nova:memory>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:disk>1</nova:disk>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:swap>0</nova:swap>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:vcpus>1</nova:vcpus>
Nov 10 12:01:28 user nova-compute[74889]:   </nova:flavor>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:owner>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:user uuid="d9f9a0d401cc4f53b97396ec66e5ac69">tempest-TaggedAttachmentsTest-866426842-project-member</nova:user>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:project uuid="9bfc5c65f3ec4fedb9b968e20399aeab">tempest-TaggedAttachmentsTest-866426842</nova:project>
Nov 10 12:01:28 user nova-compute[74889]:   </nova:owner>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:01:28 user nova-compute[74889]:   <nova:ports>
Nov 10 12:01:28 user nova-compute[74889]:     <nova:port uuid="9616e5e2-f3ec-455f-b303-9dd4bede6596">
Nov 10 12:01:28 user nova-compute[74889]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:01:28 user nova-compute[74889]:     </nova:port>
Nov 10 12:01:28 user nova-compute[74889]:   </nova:ports>
Nov 10 12:01:28 user nova-compute[74889]: </nova:instance>
Nov 10 12:01:28 user nova-compute[74889]:  {{(pid=74889) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-deleted-b97913e7-3fad-42b9-8464-3e045a5d9f95 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:29 user nova-compute[74889]: INFO nova.compute.manager [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Neutron deleted interface b97913e7-3fad-42b9-8464-3e045a5d9f95; detaching it from the instance and deleting it from the info cache
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.network.neutron [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updating instance_info_cache with network_info: [{"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquired lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.network.neutron [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.objects.instance [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] Lazy-loading 'system_metadata' on Instance uuid d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.objects.instance [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] Lazy-loading 'flavor' on Instance uuid d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.objects.base [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] Object Instance<d6a0ffdd-1c72-4a34-b652-d14a01965ad5> lazy-loaded attributes: system_metadata,flavor {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021355343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021355343',id=15,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0vequKP+K5HhXnSZEekp/UTgizqm44CF7EwBTHzQ3YrW5/0KlwgVsmqJxdfyDOzcFvmhjOI1nY67HVgkbNSp+Wusi+soHfSh0U5hG8mvTVgzxbmEuelIU3LcM+ZQt2JQ==',key_name='tempest-keypair-1815934162',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:58:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfc5c65f3ec4fedb9b968e20399aeab',ramdisk_id='',reservation_id='r-sc38cubd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-866426842',owner_user_name='tempest-TaggedAttachmentsTest-866426842-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f9a0d401cc4f53b97396ec66e5ac69',uuid=d6a0ffdd-1c72-4a34-b652-d14a01965ad5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.network.os_vif_util [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] Converting VIF {"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.network.os_vif_util [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:f1:48"/><model type="virtio"/><mtu size="1442"/><target dev="tapb97913e7-3f"/></interface> {{(pid=74889) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:eb:f1:48"/><model type="virtio"/><mtu size="1442"/><target dev="tapb97913e7-3f"/></interface>not found in domain: <domain type='kvm' id='18'>
Nov 10 12:01:29 user nova-compute[74889]:   <name>instance-0000000f</name>
Nov 10 12:01:29 user nova-compute[74889]:   <uuid>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</uuid>
Nov 10 12:01:29 user nova-compute[74889]:   <metadata>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:01:29 user nova-compute[74889]:   <nova:package version="0.0.0"/>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:name>tempest-device-tagging-server-2021355343</nova:name>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:creationTime>2023-11-10 12:01:28</nova:creationTime>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:flavor name="m1.tiny">
Nov 10 12:01:29 user nova-compute[74889]:     <nova:memory>512</nova:memory>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:disk>1</nova:disk>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:swap>0</nova:swap>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:vcpus>1</nova:vcpus>
Nov 10 12:01:29 user nova-compute[74889]:   </nova:flavor>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:owner>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:user uuid="d9f9a0d401cc4f53b97396ec66e5ac69">tempest-TaggedAttachmentsTest-866426842-project-member</nova:user>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:project uuid="9bfc5c65f3ec4fedb9b968e20399aeab">tempest-TaggedAttachmentsTest-866426842</nova:project>
Nov 10 12:01:29 user nova-compute[74889]:   </nova:owner>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:ports>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:port uuid="9616e5e2-f3ec-455f-b303-9dd4bede6596">
Nov 10 12:01:29 user nova-compute[74889]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:01:29 user nova-compute[74889]:     </nova:port>
Nov 10 12:01:29 user nova-compute[74889]:   </nova:ports>
Nov 10 12:01:29 user nova-compute[74889]: </nova:instance>
Nov 10 12:01:29 user nova-compute[74889]:   </metadata>
Nov 10 12:01:29 user nova-compute[74889]:   <memory unit='KiB'>524288</memory>
Nov 10 12:01:29 user nova-compute[74889]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 12:01:29 user nova-compute[74889]:   <vcpu placement='static'>1</vcpu>
Nov 10 12:01:29 user nova-compute[74889]:   <resource>
Nov 10 12:01:29 user nova-compute[74889]:     <partition>/machine</partition>
Nov 10 12:01:29 user nova-compute[74889]:   </resource>
Nov 10 12:01:29 user nova-compute[74889]:   <sysinfo type='smbios'>
Nov 10 12:01:29 user nova-compute[74889]:     <system>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='version'>0.0.0</entry>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='serial'>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</entry>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='uuid'>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</entry>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='family'>Virtual Machine</entry>
Nov 10 12:01:29 user nova-compute[74889]:     </system>
Nov 10 12:01:29 user nova-compute[74889]:   </sysinfo>
Nov 10 12:01:29 user nova-compute[74889]:   <os>
Nov 10 12:01:29 user nova-compute[74889]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 12:01:29 user nova-compute[74889]:     <boot dev='hd'/>
Nov 10 12:01:29 user nova-compute[74889]:     <smbios mode='sysinfo'/>
Nov 10 12:01:29 user nova-compute[74889]:   </os>
Nov 10 12:01:29 user nova-compute[74889]:   <features>
Nov 10 12:01:29 user nova-compute[74889]:     <acpi/>
Nov 10 12:01:29 user nova-compute[74889]:     <apic/>
Nov 10 12:01:29 user nova-compute[74889]:     <vmcoreinfo state='on'/>
Nov 10 12:01:29 user nova-compute[74889]:   </features>
Nov 10 12:01:29 user nova-compute[74889]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 12:01:29 user nova-compute[74889]:     <model fallback='forbid'>Nehalem</model>
Nov 10 12:01:29 user nova-compute[74889]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 12:01:29 user nova-compute[74889]:     <feature policy='require' name='vme'/>
Nov 10 12:01:29 user nova-compute[74889]:     <feature policy='require' name='x2apic'/>
Nov 10 12:01:29 user nova-compute[74889]:     <feature policy='require' name='hypervisor'/>
Nov 10 12:01:29 user nova-compute[74889]:   </cpu>
Nov 10 12:01:29 user nova-compute[74889]:   <clock offset='utc'>
Nov 10 12:01:29 user nova-compute[74889]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 12:01:29 user nova-compute[74889]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 12:01:29 user nova-compute[74889]:     <timer name='hpet' present='no'/>
Nov 10 12:01:29 user nova-compute[74889]:   </clock>
Nov 10 12:01:29 user nova-compute[74889]:   <on_poweroff>destroy</on_poweroff>
Nov 10 12:01:29 user nova-compute[74889]:   <on_reboot>restart</on_reboot>
Nov 10 12:01:29 user nova-compute[74889]:   <on_crash>destroy</on_crash>
Nov 10 12:01:29 user nova-compute[74889]:   <devices>
Nov 10 12:01:29 user nova-compute[74889]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 12:01:29 user nova-compute[74889]:     <disk type='file' device='disk'>
Nov 10 12:01:29 user nova-compute[74889]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 12:01:29 user nova-compute[74889]:       <source file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk' index='2'/>
Nov 10 12:01:29 user nova-compute[74889]:       <backingStore type='file' index='3'>
Nov 10 12:01:29 user nova-compute[74889]:         <format type='raw'/>
Nov 10 12:01:29 user nova-compute[74889]:         <source file='/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a'/>
Nov 10 12:01:29 user nova-compute[74889]:         <backingStore/>
Nov 10 12:01:29 user nova-compute[74889]:       </backingStore>
Nov 10 12:01:29 user nova-compute[74889]:       <target dev='vda' bus='virtio'/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='virtio-disk0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </disk>
Nov 10 12:01:29 user nova-compute[74889]:     <disk type='file' device='cdrom'>
Nov 10 12:01:29 user nova-compute[74889]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 12:01:29 user nova-compute[74889]:       <source file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.config' index='1'/>
Nov 10 12:01:29 user nova-compute[74889]:       <backingStore/>
Nov 10 12:01:29 user nova-compute[74889]:       <target dev='hda' bus='ide'/>
Nov 10 12:01:29 user nova-compute[74889]:       <readonly/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='ide0-0-0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </disk>
Nov 10 12:01:29 user nova-compute[74889]:     <controller type='usb' index='0' model='none'>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='usb'/>
Nov 10 12:01:29 user nova-compute[74889]:     </controller>
Nov 10 12:01:29 user nova-compute[74889]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='pci.0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </controller>
Nov 10 12:01:29 user nova-compute[74889]:     <controller type='ide' index='0'>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='ide'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 12:01:29 user nova-compute[74889]:     </controller>
Nov 10 12:01:29 user nova-compute[74889]:     <interface type='ethernet'>
Nov 10 12:01:29 user nova-compute[74889]:       <mac address='fa:16:3e:34:c5:6e'/>
Nov 10 12:01:29 user nova-compute[74889]:       <target dev='tap9616e5e2-f3'/>
Nov 10 12:01:29 user nova-compute[74889]:       <model type='virtio'/>
Nov 10 12:01:29 user nova-compute[74889]:       <mtu size='1442'/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='net0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </interface>
Nov 10 12:01:29 user nova-compute[74889]:     <serial type='pty'>
Nov 10 12:01:29 user nova-compute[74889]:       <source path='/dev/pts/7'/>
Nov 10 12:01:29 user nova-compute[74889]:       <log file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/console.log' append='off'/>
Nov 10 12:01:29 user nova-compute[74889]:       <target type='isa-serial' port='0'>
Nov 10 12:01:29 user nova-compute[74889]:         <model name='isa-serial'/>
Nov 10 12:01:29 user nova-compute[74889]:       </target>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='serial0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </serial>
Nov 10 12:01:29 user nova-compute[74889]:     <console type='pty' tty='/dev/pts/7'>
Nov 10 12:01:29 user nova-compute[74889]:       <source path='/dev/pts/7'/>
Nov 10 12:01:29 user nova-compute[74889]:       <log file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/console.log' append='off'/>
Nov 10 12:01:29 user nova-compute[74889]:       <target type='serial' port='0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='serial0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </console>
Nov 10 12:01:29 user nova-compute[74889]:     <input type='mouse' bus='ps2'>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='input0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </input>
Nov 10 12:01:29 user nova-compute[74889]:     <input type='keyboard' bus='ps2'>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='input1'/>
Nov 10 12:01:29 user nova-compute[74889]:     </input>
Nov 10 12:01:29 user nova-compute[74889]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 10 12:01:29 user nova-compute[74889]:       <listen type='address' address='0.0.0.0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </graphics>
Nov 10 12:01:29 user nova-compute[74889]:     <audio id='1' type='none'/>
Nov 10 12:01:29 user nova-compute[74889]:     <video>
Nov 10 12:01:29 user nova-compute[74889]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='video0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </video>
Nov 10 12:01:29 user nova-compute[74889]:     <memballoon model='virtio'>
Nov 10 12:01:29 user nova-compute[74889]:       <stats period='10'/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='balloon0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </memballoon>
Nov 10 12:01:29 user nova-compute[74889]:     <rng model='virtio'>
Nov 10 12:01:29 user nova-compute[74889]:       <backend model='random'>/dev/urandom</backend>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='rng0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </rng>
Nov 10 12:01:29 user nova-compute[74889]:   </devices>
Nov 10 12:01:29 user nova-compute[74889]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 12:01:29 user nova-compute[74889]:     <label>libvirt-d6a0ffdd-1c72-4a34-b652-d14a01965ad5</label>
Nov 10 12:01:29 user nova-compute[74889]:     <imagelabel>libvirt-d6a0ffdd-1c72-4a34-b652-d14a01965ad5</imagelabel>
Nov 10 12:01:29 user nova-compute[74889]:   </seclabel>
Nov 10 12:01:29 user nova-compute[74889]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 12:01:29 user nova-compute[74889]:     <label>+64055:+108</label>
Nov 10 12:01:29 user nova-compute[74889]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 12:01:29 user nova-compute[74889]:   </seclabel>
Nov 10 12:01:29 user nova-compute[74889]: </domain>
Nov 10 12:01:29 user nova-compute[74889]:  {{(pid=74889) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:eb:f1:48"/><model type="virtio"/><mtu size="1442"/><target dev="tapb97913e7-3f"/></interface> {{(pid=74889) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:eb:f1:48"/><model type="virtio"/><mtu size="1442"/><target dev="tapb97913e7-3f"/></interface>not found in domain: <domain type='kvm' id='18'>
Nov 10 12:01:29 user nova-compute[74889]:   <name>instance-0000000f</name>
Nov 10 12:01:29 user nova-compute[74889]:   <uuid>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</uuid>
Nov 10 12:01:29 user nova-compute[74889]:   <metadata>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:01:29 user nova-compute[74889]:   <nova:package version="0.0.0"/>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:name>tempest-device-tagging-server-2021355343</nova:name>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:creationTime>2023-11-10 12:01:28</nova:creationTime>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:flavor name="m1.tiny">
Nov 10 12:01:29 user nova-compute[74889]:     <nova:memory>512</nova:memory>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:disk>1</nova:disk>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:swap>0</nova:swap>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:vcpus>1</nova:vcpus>
Nov 10 12:01:29 user nova-compute[74889]:   </nova:flavor>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:owner>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:user uuid="d9f9a0d401cc4f53b97396ec66e5ac69">tempest-TaggedAttachmentsTest-866426842-project-member</nova:user>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:project uuid="9bfc5c65f3ec4fedb9b968e20399aeab">tempest-TaggedAttachmentsTest-866426842</nova:project>
Nov 10 12:01:29 user nova-compute[74889]:   </nova:owner>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:ports>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:port uuid="9616e5e2-f3ec-455f-b303-9dd4bede6596">
Nov 10 12:01:29 user nova-compute[74889]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:01:29 user nova-compute[74889]:     </nova:port>
Nov 10 12:01:29 user nova-compute[74889]:   </nova:ports>
Nov 10 12:01:29 user nova-compute[74889]: </nova:instance>
Nov 10 12:01:29 user nova-compute[74889]:   </metadata>
Nov 10 12:01:29 user nova-compute[74889]:   <memory unit='KiB'>524288</memory>
Nov 10 12:01:29 user nova-compute[74889]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 12:01:29 user nova-compute[74889]:   <vcpu placement='static'>1</vcpu>
Nov 10 12:01:29 user nova-compute[74889]:   <resource>
Nov 10 12:01:29 user nova-compute[74889]:     <partition>/machine</partition>
Nov 10 12:01:29 user nova-compute[74889]:   </resource>
Nov 10 12:01:29 user nova-compute[74889]:   <sysinfo type='smbios'>
Nov 10 12:01:29 user nova-compute[74889]:     <system>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='version'>0.0.0</entry>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='serial'>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</entry>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='uuid'>d6a0ffdd-1c72-4a34-b652-d14a01965ad5</entry>
Nov 10 12:01:29 user nova-compute[74889]:       <entry name='family'>Virtual Machine</entry>
Nov 10 12:01:29 user nova-compute[74889]:     </system>
Nov 10 12:01:29 user nova-compute[74889]:   </sysinfo>
Nov 10 12:01:29 user nova-compute[74889]:   <os>
Nov 10 12:01:29 user nova-compute[74889]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 12:01:29 user nova-compute[74889]:     <boot dev='hd'/>
Nov 10 12:01:29 user nova-compute[74889]:     <smbios mode='sysinfo'/>
Nov 10 12:01:29 user nova-compute[74889]:   </os>
Nov 10 12:01:29 user nova-compute[74889]:   <features>
Nov 10 12:01:29 user nova-compute[74889]:     <acpi/>
Nov 10 12:01:29 user nova-compute[74889]:     <apic/>
Nov 10 12:01:29 user nova-compute[74889]:     <vmcoreinfo state='on'/>
Nov 10 12:01:29 user nova-compute[74889]:   </features>
Nov 10 12:01:29 user nova-compute[74889]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 12:01:29 user nova-compute[74889]:     <model fallback='forbid'>Nehalem</model>
Nov 10 12:01:29 user nova-compute[74889]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 12:01:29 user nova-compute[74889]:     <feature policy='require' name='vme'/>
Nov 10 12:01:29 user nova-compute[74889]:     <feature policy='require' name='x2apic'/>
Nov 10 12:01:29 user nova-compute[74889]:     <feature policy='require' name='hypervisor'/>
Nov 10 12:01:29 user nova-compute[74889]:   </cpu>
Nov 10 12:01:29 user nova-compute[74889]:   <clock offset='utc'>
Nov 10 12:01:29 user nova-compute[74889]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 12:01:29 user nova-compute[74889]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 12:01:29 user nova-compute[74889]:     <timer name='hpet' present='no'/>
Nov 10 12:01:29 user nova-compute[74889]:   </clock>
Nov 10 12:01:29 user nova-compute[74889]:   <on_poweroff>destroy</on_poweroff>
Nov 10 12:01:29 user nova-compute[74889]:   <on_reboot>restart</on_reboot>
Nov 10 12:01:29 user nova-compute[74889]:   <on_crash>destroy</on_crash>
Nov 10 12:01:29 user nova-compute[74889]:   <devices>
Nov 10 12:01:29 user nova-compute[74889]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 12:01:29 user nova-compute[74889]:     <disk type='file' device='disk'>
Nov 10 12:01:29 user nova-compute[74889]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 12:01:29 user nova-compute[74889]:       <source file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk' index='2'/>
Nov 10 12:01:29 user nova-compute[74889]:       <backingStore type='file' index='3'>
Nov 10 12:01:29 user nova-compute[74889]:         <format type='raw'/>
Nov 10 12:01:29 user nova-compute[74889]:         <source file='/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a'/>
Nov 10 12:01:29 user nova-compute[74889]:         <backingStore/>
Nov 10 12:01:29 user nova-compute[74889]:       </backingStore>
Nov 10 12:01:29 user nova-compute[74889]:       <target dev='vda' bus='virtio'/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='virtio-disk0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </disk>
Nov 10 12:01:29 user nova-compute[74889]:     <disk type='file' device='cdrom'>
Nov 10 12:01:29 user nova-compute[74889]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 12:01:29 user nova-compute[74889]:       <source file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk.config' index='1'/>
Nov 10 12:01:29 user nova-compute[74889]:       <backingStore/>
Nov 10 12:01:29 user nova-compute[74889]:       <target dev='hda' bus='ide'/>
Nov 10 12:01:29 user nova-compute[74889]:       <readonly/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='ide0-0-0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </disk>
Nov 10 12:01:29 user nova-compute[74889]:     <controller type='usb' index='0' model='none'>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='usb'/>
Nov 10 12:01:29 user nova-compute[74889]:     </controller>
Nov 10 12:01:29 user nova-compute[74889]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='pci.0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </controller>
Nov 10 12:01:29 user nova-compute[74889]:     <controller type='ide' index='0'>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='ide'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 12:01:29 user nova-compute[74889]:     </controller>
Nov 10 12:01:29 user nova-compute[74889]:     <interface type='ethernet'>
Nov 10 12:01:29 user nova-compute[74889]:       <mac address='fa:16:3e:34:c5:6e'/>
Nov 10 12:01:29 user nova-compute[74889]:       <target dev='tap9616e5e2-f3'/>
Nov 10 12:01:29 user nova-compute[74889]:       <model type='virtio'/>
Nov 10 12:01:29 user nova-compute[74889]:       <mtu size='1442'/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='net0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </interface>
Nov 10 12:01:29 user nova-compute[74889]:     <serial type='pty'>
Nov 10 12:01:29 user nova-compute[74889]:       <source path='/dev/pts/7'/>
Nov 10 12:01:29 user nova-compute[74889]:       <log file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/console.log' append='off'/>
Nov 10 12:01:29 user nova-compute[74889]:       <target type='isa-serial' port='0'>
Nov 10 12:01:29 user nova-compute[74889]:         <model name='isa-serial'/>
Nov 10 12:01:29 user nova-compute[74889]:       </target>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='serial0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </serial>
Nov 10 12:01:29 user nova-compute[74889]:     <console type='pty' tty='/dev/pts/7'>
Nov 10 12:01:29 user nova-compute[74889]:       <source path='/dev/pts/7'/>
Nov 10 12:01:29 user nova-compute[74889]:       <log file='/opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/console.log' append='off'/>
Nov 10 12:01:29 user nova-compute[74889]:       <target type='serial' port='0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='serial0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </console>
Nov 10 12:01:29 user nova-compute[74889]:     <input type='mouse' bus='ps2'>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='input0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </input>
Nov 10 12:01:29 user nova-compute[74889]:     <input type='keyboard' bus='ps2'>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='input1'/>
Nov 10 12:01:29 user nova-compute[74889]:     </input>
Nov 10 12:01:29 user nova-compute[74889]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 10 12:01:29 user nova-compute[74889]:       <listen type='address' address='0.0.0.0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </graphics>
Nov 10 12:01:29 user nova-compute[74889]:     <audio id='1' type='none'/>
Nov 10 12:01:29 user nova-compute[74889]:     <video>
Nov 10 12:01:29 user nova-compute[74889]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='video0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </video>
Nov 10 12:01:29 user nova-compute[74889]:     <memballoon model='virtio'>
Nov 10 12:01:29 user nova-compute[74889]:       <stats period='10'/>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='balloon0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </memballoon>
Nov 10 12:01:29 user nova-compute[74889]:     <rng model='virtio'>
Nov 10 12:01:29 user nova-compute[74889]:       <backend model='random'>/dev/urandom</backend>
Nov 10 12:01:29 user nova-compute[74889]:       <alias name='rng0'/>
Nov 10 12:01:29 user nova-compute[74889]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 12:01:29 user nova-compute[74889]:     </rng>
Nov 10 12:01:29 user nova-compute[74889]:   </devices>
Nov 10 12:01:29 user nova-compute[74889]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 12:01:29 user nova-compute[74889]:     <label>libvirt-d6a0ffdd-1c72-4a34-b652-d14a01965ad5</label>
Nov 10 12:01:29 user nova-compute[74889]:     <imagelabel>libvirt-d6a0ffdd-1c72-4a34-b652-d14a01965ad5</imagelabel>
Nov 10 12:01:29 user nova-compute[74889]:   </seclabel>
Nov 10 12:01:29 user nova-compute[74889]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 12:01:29 user nova-compute[74889]:     <label>+64055:+108</label>
Nov 10 12:01:29 user nova-compute[74889]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 12:01:29 user nova-compute[74889]:   </seclabel>
Nov 10 12:01:29 user nova-compute[74889]: </domain>
Nov 10 12:01:29 user nova-compute[74889]:  {{(pid=74889) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 12:01:29 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Detaching interface fa:16:3e:eb:f1:48 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapb97913e7-3f' not found.
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021355343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021355343',id=15,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0vequKP+K5HhXnSZEekp/UTgizqm44CF7EwBTHzQ3YrW5/0KlwgVsmqJxdfyDOzcFvmhjOI1nY67HVgkbNSp+Wusi+soHfSh0U5hG8mvTVgzxbmEuelIU3LcM+ZQt2JQ==',key_name='tempest-keypair-1815934162',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:58:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfc5c65f3ec4fedb9b968e20399aeab',ramdisk_id='',reservation_id='r-sc38cubd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-866426842',owner_user_name='tempest-TaggedAttachmentsTest-866426842-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f9a0d401cc4f53b97396ec66e5ac69',uuid=d6a0ffdd-1c72-4a34-b652-d14a01965ad5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.network.os_vif_util [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] Converting VIF {"id": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "address": "fa:16:3e:eb:f1:48", "network": {"id": "ed593d70-b394-4b5e-8272-b5c37921994d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-498190675", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb97913e7-3f", "ovs_interfaceid": "b97913e7-3fad-42b9-8464-3e045a5d9f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.network.os_vif_util [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG os_vif [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb97913e7-3f, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:01:29 user nova-compute[74889]: INFO os_vif [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f1:48,bridge_name='br-int',has_traffic_filtering=True,id=b97913e7-3fad-42b9-8464-3e045a5d9f95,network=Network(ed593d70-b394-4b5e-8272-b5c37921994d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb97913e7-3f')
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [req-e8319bf9-41c3-44f5-a9a1-020297dbf391 req-aa377356-e062-424e-a98a-53098e0666de service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:01:29 user nova-compute[74889]:   <nova:package version="0.0.0"/>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:name>tempest-device-tagging-server-2021355343</nova:name>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:creationTime>2023-11-10 12:01:29</nova:creationTime>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:flavor name="m1.tiny">
Nov 10 12:01:29 user nova-compute[74889]:     <nova:memory>512</nova:memory>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:disk>1</nova:disk>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:swap>0</nova:swap>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:vcpus>1</nova:vcpus>
Nov 10 12:01:29 user nova-compute[74889]:   </nova:flavor>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:owner>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:user uuid="d9f9a0d401cc4f53b97396ec66e5ac69">tempest-TaggedAttachmentsTest-866426842-project-member</nova:user>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:project uuid="9bfc5c65f3ec4fedb9b968e20399aeab">tempest-TaggedAttachmentsTest-866426842</nova:project>
Nov 10 12:01:29 user nova-compute[74889]:   </nova:owner>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:01:29 user nova-compute[74889]:   <nova:ports>
Nov 10 12:01:29 user nova-compute[74889]:     <nova:port uuid="9616e5e2-f3ec-455f-b303-9dd4bede6596">
Nov 10 12:01:29 user nova-compute[74889]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:01:29 user nova-compute[74889]:     </nova:port>
Nov 10 12:01:29 user nova-compute[74889]:   </nova:ports>
Nov 10 12:01:29 user nova-compute[74889]: </nova:instance>
Nov 10 12:01:29 user nova-compute[74889]:  {{(pid=74889) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG nova.network.neutron [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updating instance_info_cache with network_info: [{"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Releasing lock "refresh_cache-d6a0ffdd-1c72-4a34-b652-d14a01965ad5" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:01:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bef30263-ad67-4071-a98c-1351c17c051f tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "interface-d6a0ffdd-1c72-4a34-b652-d14a01965ad5-b97913e7-3fad-42b9-8464-3e045a5d9f95" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.302s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:30 user nova-compute[74889]: INFO nova.compute.manager [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Terminating instance
Nov 10 12:01:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-879861df-2488-4a6e-badf-8e2b9ec1845c req-e8b1bdb8-00cb-4fa6-b4d1-fde988a808bc service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-unplugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-879861df-2488-4a6e-badf-8e2b9ec1845c req-e8b1bdb8-00cb-4fa6-b4d1-fde988a808bc service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-879861df-2488-4a6e-badf-8e2b9ec1845c req-e8b1bdb8-00cb-4fa6-b4d1-fde988a808bc service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-879861df-2488-4a6e-badf-8e2b9ec1845c req-e8b1bdb8-00cb-4fa6-b4d1-fde988a808bc service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-879861df-2488-4a6e-badf-8e2b9ec1845c req-e8b1bdb8-00cb-4fa6-b4d1-fde988a808bc service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-unplugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-879861df-2488-4a6e-badf-8e2b9ec1845c req-e8b1bdb8-00cb-4fa6-b4d1-fde988a808bc service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-unplugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:01:30 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Instance destroyed successfully.
Nov 10 12:01:30 user nova-compute[74889]: DEBUG nova.objects.instance [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'resources' on Instance uuid 527ef5ba-c67a-481a-b835-e8b6196f3902 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-518100689',display_name='tempest-AttachVolumeTestJSON-server-518100689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-518100689',id=2,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEh76cZ/xflXBEdMOROgxqbhG35Jz0cqE4YYKJiGcf50O8aLCm2o2DfUHmGwzHJW0DU1jZ0rVUpQW2CmcsWOI30JbHZMThJB6IQjvv8CUUQ6Nrn1BLEBG5jDbyobMxuOg==',key_name='tempest-keypair-1235958409',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-ngy0se22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=527ef5ba-c67a-481a-b835-e8b6196f3902,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "address": "fa:16:3e:84:97:e7", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2c7fdc-3f", "ovs_interfaceid": "5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG os_vif [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b2c7fdc-3f, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a4be1a93-9714-4dd1-be62-de609d71b25f) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:01:31 user nova-compute[74889]: INFO os_vif [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:97:e7,bridge_name='br-int',has_traffic_filtering=True,id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2c7fdc-3f')
Nov 10 12:01:31 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Deleting instance files /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902_del
Nov 10 12:01:31 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Deletion of /opt/stack/data/nova/instances/527ef5ba-c67a-481a-b835-e8b6196f3902_del complete
Nov 10 12:01:31 user nova-compute[74889]: INFO nova.compute.manager [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 12:01:31 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-3b2c630a-4f78-4c06-b17a-e4e3d0077bfb req-a245e868-b94d-48fa-bbcd-f5fa8069fcaf service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-deleted-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:31 user nova-compute[74889]: INFO nova.compute.manager [req-3b2c630a-4f78-4c06-b17a-e4e3d0077bfb req-a245e868-b94d-48fa-bbcd-f5fa8069fcaf service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Neutron deleted interface 5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50; detaching it from the instance and deleting it from the info cache
Nov 10 12:01:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-3b2c630a-4f78-4c06-b17a-e4e3d0077bfb req-a245e868-b94d-48fa-bbcd-f5fa8069fcaf service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:31 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Took 0.72 seconds to deallocate network for instance.
Nov 10 12:01:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-3b2c630a-4f78-4c06-b17a-e4e3d0077bfb req-a245e868-b94d-48fa-bbcd-f5fa8069fcaf service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Detach interface failed, port_id=5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50, reason: Instance 527ef5ba-c67a-481a-b835-e8b6196f3902 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:32 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Deleted allocations for instance 527ef5ba-c67a-481a-b835-e8b6196f3902
Nov 10 12:01:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fd636b24-e6dc-4683-a31d-568f3fc24f8e tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.205s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "e71c6401-13be-4906-9988-2687a67bb50f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "e71c6401-13be-4906-9988-2687a67bb50f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "e71c6401-13be-4906-9988-2687a67bb50f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "e71c6401-13be-4906-9988-2687a67bb50f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "e71c6401-13be-4906-9988-2687a67bb50f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:32 user nova-compute[74889]: INFO nova.compute.manager [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Terminating instance
Nov 10 12:01:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-0d7c7849-d90b-453d-9714-bbabb7668959 req-dc33e066-38ac-4cf7-9ec4-31d509ee76a2 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0d7c7849-d90b-453d-9714-bbabb7668959 req-dc33e066-38ac-4cf7-9ec4-31d509ee76a2 service nova] Acquiring lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0d7c7849-d90b-453d-9714-bbabb7668959 req-dc33e066-38ac-4cf7-9ec4-31d509ee76a2 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0d7c7849-d90b-453d-9714-bbabb7668959 req-dc33e066-38ac-4cf7-9ec4-31d509ee76a2 service nova] Lock "527ef5ba-c67a-481a-b835-e8b6196f3902-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-0d7c7849-d90b-453d-9714-bbabb7668959 req-dc33e066-38ac-4cf7-9ec4-31d509ee76a2 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] No waiting events found dispatching network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:32 user nova-compute[74889]: WARNING nova.compute.manager [req-0d7c7849-d90b-453d-9714-bbabb7668959 req-dc33e066-38ac-4cf7-9ec4-31d509ee76a2 service nova] [instance: 527ef5ba-c67a-481a-b835-e8b6196f3902] Received unexpected event network-vif-plugged-5b2c7fdc-3f6e-416f-8f67-8e6ae7c92b50 for instance with vm_state deleted and task_state None.
Nov 10 12:01:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:33 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Instance destroyed successfully.
Nov 10 12:01:33 user nova-compute[74889]: DEBUG nova.objects.instance [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lazy-loading 'resources' on Instance uuid e71c6401-13be-4906-9988-2687a67bb50f {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1661965481',display_name='tempest-VolumesActionsTest-instance-1661965481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1661965481',id=20,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:59:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c664edf4b1844ed9592c9f5851b4bff',ramdisk_id='',reservation_id='r-0yfyd1yf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1744369685',owner_user_name='tempest-VolumesActionsTest-1744369685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:59:49Z,user_data=None,user_id='c0a2bf1ce37a4d05b3179b2e8573c3e1',uuid=e71c6401-13be-4906-9988-2687a67bb50f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "address": "fa:16:3e:3c:e2:ef", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11faf425-cf", "ovs_interfaceid": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converting VIF {"id": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "address": "fa:16:3e:3c:e2:ef", "network": {"id": "fbe7c51f-946e-4161-b53d-67484c19e33a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1450652084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c664edf4b1844ed9592c9f5851b4bff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11faf425-cf", "ovs_interfaceid": "11faf425-cfdf-49de-b1f2-611d2d7d7778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=11faf425-cfdf-49de-b1f2-611d2d7d7778,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11faf425-cf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG os_vif [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=11faf425-cfdf-49de-b1f2-611d2d7d7778,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11faf425-cf') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11faf425-cf, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7e99c8d-3d94-4cba-a7da-4dc400b183f9) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:01:33 user nova-compute[74889]: INFO os_vif [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:e2:ef,bridge_name='br-int',has_traffic_filtering=True,id=11faf425-cfdf-49de-b1f2-611d2d7d7778,network=Network(fbe7c51f-946e-4161-b53d-67484c19e33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11faf425-cf')
Nov 10 12:01:33 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Deleting instance files /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f_del
Nov 10 12:01:33 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Deletion of /opt/stack/data/nova/instances/e71c6401-13be-4906-9988-2687a67bb50f_del complete
Nov 10 12:01:33 user nova-compute[74889]: INFO nova.compute.manager [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 10 12:01:33 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: e71c6401-13be-4906-9988-2687a67bb50f] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:33 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Took 0.43 seconds to deallocate network for instance.
Nov 10 12:01:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-3e89356c-ab4c-4615-b0c0-bef2044daad6 req-0cda2677-9bb5-46de-acb9-a4db030e2496 service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Received event network-vif-deleted-11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:01:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:33 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Deleted allocations for instance e71c6401-13be-4906-9988-2687a67bb50f
Nov 10 12:01:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d1e13188-0f38-4456-8e47-245477166fe2 tempest-VolumesActionsTest-1744369685 tempest-VolumesActionsTest-1744369685-project-member] Lock "e71c6401-13be-4906-9988-2687a67bb50f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.634s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Received event network-vif-unplugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] Acquiring lock "e71c6401-13be-4906-9988-2687a67bb50f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] Lock "e71c6401-13be-4906-9988-2687a67bb50f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] Lock "e71c6401-13be-4906-9988-2687a67bb50f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] No waiting events found dispatching network-vif-unplugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:34 user nova-compute[74889]: WARNING nova.compute.manager [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Received unexpected event network-vif-unplugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 for instance with vm_state deleted and task_state None.
Nov 10 12:01:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Received event network-vif-plugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] Acquiring lock "e71c6401-13be-4906-9988-2687a67bb50f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] Lock "e71c6401-13be-4906-9988-2687a67bb50f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] Lock "e71c6401-13be-4906-9988-2687a67bb50f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] No waiting events found dispatching network-vif-plugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:34 user nova-compute[74889]: WARNING nova.compute.manager [req-7d2afc0f-6abe-49ce-8ec8-5e269b4d2b1c req-a4d2abeb-10ad-4f98-b3f8-051a67f98bac service nova] [instance: e71c6401-13be-4906-9988-2687a67bb50f] Received unexpected event network-vif-plugged-11faf425-cfdf-49de-b1f2-611d2d7d7778 for instance with vm_state deleted and task_state None.
Nov 10 12:01:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "99116b0a-7426-4846-9a4b-dcf0bba5409f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:36 user nova-compute[74889]: INFO nova.compute.manager [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Terminating instance
Nov 10 12:01:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-adc9cecd-0cd7-40b5-9f1f-670b1924c574 req-288445ee-a85c-46bf-bca8-15ba42da193f service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Received event network-vif-unplugged-fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-adc9cecd-0cd7-40b5-9f1f-670b1924c574 req-288445ee-a85c-46bf-bca8-15ba42da193f service nova] Acquiring lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-adc9cecd-0cd7-40b5-9f1f-670b1924c574 req-288445ee-a85c-46bf-bca8-15ba42da193f service nova] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-adc9cecd-0cd7-40b5-9f1f-670b1924c574 req-288445ee-a85c-46bf-bca8-15ba42da193f service nova] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-adc9cecd-0cd7-40b5-9f1f-670b1924c574 req-288445ee-a85c-46bf-bca8-15ba42da193f service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] No waiting events found dispatching network-vif-unplugged-fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-adc9cecd-0cd7-40b5-9f1f-670b1924c574 req-288445ee-a85c-46bf-bca8-15ba42da193f service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Received event network-vif-unplugged-fd870488-1a98-47e6-8f24-9be244058542 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:01:36 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Instance destroyed successfully.
Nov 10 12:01:36 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lazy-loading 'resources' on Instance uuid 99116b0a-7426-4846-9a4b-dcf0bba5409f {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:59:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1205981455',display_name='tempest-VolumesAdminNegativeTest-server-1205981455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1205981455',id=19,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:59:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74f4a33c330842ba9dca41b5a174a07d',ramdisk_id='',reservation_id='r-ct11cshw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-35604331',owner_user_name='tempest-VolumesAdminNegativeTest-35604331-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:59:36Z,user_data=None,user_id='d028f217bd5b4a3994139d537c623bc5',uuid=99116b0a-7426-4846-9a4b-dcf0bba5409f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd870488-1a98-47e6-8f24-9be244058542", "address": "fa:16:3e:f3:16:90", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd870488-1a", "ovs_interfaceid": "fd870488-1a98-47e6-8f24-9be244058542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converting VIF {"id": "fd870488-1a98-47e6-8f24-9be244058542", "address": "fa:16:3e:f3:16:90", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd870488-1a", "ovs_interfaceid": "fd870488-1a98-47e6-8f24-9be244058542", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:16:90,bridge_name='br-int',has_traffic_filtering=True,id=fd870488-1a98-47e6-8f24-9be244058542,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd870488-1a') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG os_vif [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:16:90,bridge_name='br-int',has_traffic_filtering=True,id=fd870488-1a98-47e6-8f24-9be244058542,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd870488-1a') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd870488-1a, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bf7ee8f-cc29-41c6-8fd2-cf08ea093d03) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:36 user nova-compute[74889]: INFO os_vif [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:16:90,bridge_name='br-int',has_traffic_filtering=True,id=fd870488-1a98-47e6-8f24-9be244058542,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd870488-1a')
Nov 10 12:01:36 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Deleting instance files /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f_del
Nov 10 12:01:36 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Deletion of /opt/stack/data/nova/instances/99116b0a-7426-4846-9a4b-dcf0bba5409f_del complete
Nov 10 12:01:37 user nova-compute[74889]: INFO nova.compute.manager [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:01:37 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Took 0.39 seconds to deallocate network for instance.
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:37 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Deleted allocations for instance 99116b0a-7426-4846-9a4b-dcf0bba5409f
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6cfbc60e-f9c4-42cc-90ad-9f94a66b30cd tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.699s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-6f7d6b7b-205f-4f7e-b04b-4a66492d0b98 req-ca36e832-6fc1-4fce-b4c3-7d18e13e84fd service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Received event network-vif-plugged-fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6f7d6b7b-205f-4f7e-b04b-4a66492d0b98 req-ca36e832-6fc1-4fce-b4c3-7d18e13e84fd service nova] Acquiring lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6f7d6b7b-205f-4f7e-b04b-4a66492d0b98 req-ca36e832-6fc1-4fce-b4c3-7d18e13e84fd service nova] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6f7d6b7b-205f-4f7e-b04b-4a66492d0b98 req-ca36e832-6fc1-4fce-b4c3-7d18e13e84fd service nova] Lock "99116b0a-7426-4846-9a4b-dcf0bba5409f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-6f7d6b7b-205f-4f7e-b04b-4a66492d0b98 req-ca36e832-6fc1-4fce-b4c3-7d18e13e84fd service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] No waiting events found dispatching network-vif-plugged-fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:38 user nova-compute[74889]: WARNING nova.compute.manager [req-6f7d6b7b-205f-4f7e-b04b-4a66492d0b98 req-ca36e832-6fc1-4fce-b4c3-7d18e13e84fd service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Received unexpected event network-vif-plugged-fd870488-1a98-47e6-8f24-9be244058542 for instance with vm_state deleted and task_state None.
Nov 10 12:01:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-6f7d6b7b-205f-4f7e-b04b-4a66492d0b98 req-ca36e832-6fc1-4fce-b4c3-7d18e13e84fd service nova] [instance: 99116b0a-7426-4846-9a4b-dcf0bba5409f] Received event network-vif-deleted-fd870488-1a98-47e6-8f24-9be244058542 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:01:41 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:01:41 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7439MB free_disk=25.29119110107422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6200554d-5be6-48b4-90e9-4151006d8ce3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 61077e59-6249-4a6e-b749-733ed9735bb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 93367290-6fa4-4bbe-b47b-2dfa27227bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 22718082-4c44-4384-8692-c216bb1a14e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance ef39ec05-9c6e-4f3f-9881-8777f72073a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:43 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:01:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:01:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:01:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:01:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Updating instance_info_cache with network_info: [{"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-61077e59-6249-4a6e-b749-733ed9735bb2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:01:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:01:45 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:46 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 12:01:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:47 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:47 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:47 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:01:48 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:01:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 12:01:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 12:01:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-95b69eef-a606-4e25-bada-f5dd8e22cb32 req-38500245-ee37-4b54-ae48-bb30e82db2de service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-changed-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-95b69eef-a606-4e25-bada-f5dd8e22cb32 req-38500245-ee37-4b54-ae48-bb30e82db2de service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Refreshing instance network info cache due to event network-changed-37d0a738-3b02-4291-90e6-20f0a0215ab9. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:01:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-95b69eef-a606-4e25-bada-f5dd8e22cb32 req-38500245-ee37-4b54-ae48-bb30e82db2de service nova] Acquiring lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:01:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-95b69eef-a606-4e25-bada-f5dd8e22cb32 req-38500245-ee37-4b54-ae48-bb30e82db2de service nova] Acquired lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:01:49 user nova-compute[74889]: DEBUG nova.network.neutron [req-95b69eef-a606-4e25-bada-f5dd8e22cb32 req-38500245-ee37-4b54-ae48-bb30e82db2de service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Refreshing network info cache for port 37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:01:50 user nova-compute[74889]: DEBUG nova.network.neutron [req-95b69eef-a606-4e25-bada-f5dd8e22cb32 req-38500245-ee37-4b54-ae48-bb30e82db2de service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updated VIF entry in instance network info cache for port 37d0a738-3b02-4291-90e6-20f0a0215ab9. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:01:50 user nova-compute[74889]: DEBUG nova.network.neutron [req-95b69eef-a606-4e25-bada-f5dd8e22cb32 req-38500245-ee37-4b54-ae48-bb30e82db2de service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updating instance_info_cache with network_info: [{"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-95b69eef-a606-4e25-bada-f5dd8e22cb32 req-38500245-ee37-4b54-ae48-bb30e82db2de service nova] Releasing lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:01:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-23ee3dfd-3aca-4ced-a958-1d115da0cc4c req-761aa1a3-1fb1-41ac-8eb9-93ee17a872ec service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-changed-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-23ee3dfd-3aca-4ced-a958-1d115da0cc4c req-761aa1a3-1fb1-41ac-8eb9-93ee17a872ec service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Refreshing instance network info cache due to event network-changed-37d0a738-3b02-4291-90e6-20f0a0215ab9. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:01:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-23ee3dfd-3aca-4ced-a958-1d115da0cc4c req-761aa1a3-1fb1-41ac-8eb9-93ee17a872ec service nova] Acquiring lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:01:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-23ee3dfd-3aca-4ced-a958-1d115da0cc4c req-761aa1a3-1fb1-41ac-8eb9-93ee17a872ec service nova] Acquired lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:01:50 user nova-compute[74889]: DEBUG nova.network.neutron [req-23ee3dfd-3aca-4ced-a958-1d115da0cc4c req-761aa1a3-1fb1-41ac-8eb9-93ee17a872ec service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Refreshing network info cache for port 37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:01:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:51 user nova-compute[74889]: INFO nova.compute.manager [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Detaching volume 4eb06668-3486-48c6-9f64-1df49ce73aad
Nov 10 12:01:51 user nova-compute[74889]: INFO nova.virt.block_device [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Attempting to driver detach volume 4eb06668-3486-48c6-9f64-1df49ce73aad from mountpoint /dev/vdb
Nov 10 12:01:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Attempting to detach device vdb from instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:01:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:01:51 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:01:51 user nova-compute[74889]:   <source dev="/dev/sdc"/>
Nov 10 12:01:51 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:01:51 user nova-compute[74889]:   <serial>4eb06668-3486-48c6-9f64-1df49ce73aad</serial>
Nov 10 12:01:51 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 12:01:51 user nova-compute[74889]: </disk>
Nov 10 12:01:51 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:01:51 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Successfully detached device vdb from instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b from the persistent domain config.
Nov 10 12:01:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:01:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:01:51 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:01:51 user nova-compute[74889]:   <source dev="/dev/sdc"/>
Nov 10 12:01:51 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:01:51 user nova-compute[74889]:   <serial>4eb06668-3486-48c6-9f64-1df49ce73aad</serial>
Nov 10 12:01:51 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 12:01:51 user nova-compute[74889]: </disk>
Nov 10 12:01:51 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:01:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-23ee3dfd-3aca-4ced-a958-1d115da0cc4c req-761aa1a3-1fb1-41ac-8eb9-93ee17a872ec service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updated VIF entry in instance network info cache for port 37d0a738-3b02-4291-90e6-20f0a0215ab9. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:01:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-23ee3dfd-3aca-4ced-a958-1d115da0cc4c req-761aa1a3-1fb1-41ac-8eb9-93ee17a872ec service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updating instance_info_cache with network_info: [{"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:01:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-23ee3dfd-3aca-4ced-a958-1d115da0cc4c req-761aa1a3-1fb1-41ac-8eb9-93ee17a872ec service nova] Releasing lock "refresh_cache-51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:01:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:01:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:58 user nova-compute[74889]: INFO nova.compute.manager [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Terminating instance
Nov 10 12:01:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-3045a05d-4b47-438e-acf1-3d8575575d1e req-8d819f49-66c7-4e0d-8e53-a539606329c9 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-unplugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3045a05d-4b47-438e-acf1-3d8575575d1e req-8d819f49-66c7-4e0d-8e53-a539606329c9 service nova] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3045a05d-4b47-438e-acf1-3d8575575d1e req-8d819f49-66c7-4e0d-8e53-a539606329c9 service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3045a05d-4b47-438e-acf1-3d8575575d1e req-8d819f49-66c7-4e0d-8e53-a539606329c9 service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-3045a05d-4b47-438e-acf1-3d8575575d1e req-8d819f49-66c7-4e0d-8e53-a539606329c9 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] No waiting events found dispatching network-vif-unplugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-3045a05d-4b47-438e-acf1-3d8575575d1e req-8d819f49-66c7-4e0d-8e53-a539606329c9 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-unplugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:01:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Instance destroyed successfully.
Nov 10 12:01:59 user nova-compute[74889]: DEBUG nova.objects.instance [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lazy-loading 'resources' on Instance uuid d6a0ffdd-1c72-4a34-b652-d14a01965ad5 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T11:58:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2021355343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2021355343',id=15,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0vequKP+K5HhXnSZEekp/UTgizqm44CF7EwBTHzQ3YrW5/0KlwgVsmqJxdfyDOzcFvmhjOI1nY67HVgkbNSp+Wusi+soHfSh0U5hG8mvTVgzxbmEuelIU3LcM+ZQt2JQ==',key_name='tempest-keypair-1815934162',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:58:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9bfc5c65f3ec4fedb9b968e20399aeab',ramdisk_id='',reservation_id='r-sc38cubd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-866426842',owner_user_name='tempest-TaggedAttachmentsTest-866426842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:58:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9f9a0d401cc4f53b97396ec66e5ac69',uuid=d6a0ffdd-1c72-4a34-b652-d14a01965ad5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converting VIF {"id": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "address": "fa:16:3e:34:c5:6e", "network": {"id": "96cc5a6c-a454-447b-938a-e64c120b8b0f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1325741969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9bfc5c65f3ec4fedb9b968e20399aeab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9616e5e2-f3", "ovs_interfaceid": "9616e5e2-f3ec-455f-b303-9dd4bede6596", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:c5:6e,bridge_name='br-int',has_traffic_filtering=True,id=9616e5e2-f3ec-455f-b303-9dd4bede6596,network=Network(96cc5a6c-a454-447b-938a-e64c120b8b0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616e5e2-f3') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG os_vif [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:c5:6e,bridge_name='br-int',has_traffic_filtering=True,id=9616e5e2-f3ec-455f-b303-9dd4bede6596,network=Network(96cc5a6c-a454-447b-938a-e64c120b8b0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616e5e2-f3') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9616e5e2-f3, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81e0f73e-fd5c-4c0a-b1dd-576ad53545ef) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:01:59 user nova-compute[74889]: INFO os_vif [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:c5:6e,bridge_name='br-int',has_traffic_filtering=True,id=9616e5e2-f3ec-455f-b303-9dd4bede6596,network=Network(96cc5a6c-a454-447b-938a-e64c120b8b0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9616e5e2-f3')
Nov 10 12:01:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Deleting instance files /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5_del
Nov 10 12:01:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Deletion of /opt/stack/data/nova/instances/d6a0ffdd-1c72-4a34-b652-d14a01965ad5_del complete
Nov 10 12:01:59 user nova-compute[74889]: INFO nova.compute.manager [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 12:01:59 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:01:59 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:02:00 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:00 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Took 0.72 seconds to deallocate network for instance.
Nov 10 12:02:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-d47a9004-28ca-42dd-9a36-0e55210bce19 req-964a4ded-e924-4d6d-9e6f-e7cf574bc646 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-deleted-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:00 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:02:00 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:02:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:01 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Deleted allocations for instance d6a0ffdd-1c72-4a34-b652-d14a01965ad5
Nov 10 12:02:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8f35768e-4f46-4ab8-9710-2cf64f084589 tempest-TaggedAttachmentsTest-866426842 tempest-TaggedAttachmentsTest-866426842-project-member] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.167s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-f3da55dc-77e2-4a79-a9e0-d7e4678303f1 req-0df78140-5cd4-4b9e-a5d4-84b22ef3fbb3 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received event network-vif-plugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f3da55dc-77e2-4a79-a9e0-d7e4678303f1 req-0df78140-5cd4-4b9e-a5d4-84b22ef3fbb3 service nova] Acquiring lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f3da55dc-77e2-4a79-a9e0-d7e4678303f1 req-0df78140-5cd4-4b9e-a5d4-84b22ef3fbb3 service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f3da55dc-77e2-4a79-a9e0-d7e4678303f1 req-0df78140-5cd4-4b9e-a5d4-84b22ef3fbb3 service nova] Lock "d6a0ffdd-1c72-4a34-b652-d14a01965ad5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-f3da55dc-77e2-4a79-a9e0-d7e4678303f1 req-0df78140-5cd4-4b9e-a5d4-84b22ef3fbb3 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] No waiting events found dispatching network-vif-plugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:01 user nova-compute[74889]: WARNING nova.compute.manager [req-f3da55dc-77e2-4a79-a9e0-d7e4678303f1 req-0df78140-5cd4-4b9e-a5d4-84b22ef3fbb3 service nova] [instance: d6a0ffdd-1c72-4a34-b652-d14a01965ad5] Received unexpected event network-vif-plugged-9616e5e2-f3ec-455f-b303-9dd4bede6596 for instance with vm_state deleted and task_state None.
Nov 10 12:02:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:02:11 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b is timed out.
Nov 10 12:02:11 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Successfully detached device vdb from instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b from the live domain config.
Nov 10 12:02:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRLpXniC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:02:11 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ab4d6c-e74c-46cc-817a-208540c21458]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:02:11 user nova-compute[74889]: No targets found.
Nov 10 12:02:11 user nova-compute[74889]: iSNS:
Nov 10 12:02:11 user nova-compute[74889]: No targets found.
Nov 10 12:02:11 user nova-compute[74889]: STATIC:
Nov 10 12:02:11 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d
Nov 10 12:02:11 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:02:11 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:02:11 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad
Nov 10 12:02:11 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:02:11 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:02:11 user nova-compute[74889]: FIRMWARE:
Nov 10 12:02:11 user nova-compute[74889]: No targets found.
Nov 10 12:02:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:02:11 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:02:11 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a541c7-f071-4473-a640-7c90cfe9f6a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4744d43-6af9-4581-a678-8df566b4865b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:02:11 user nova-compute[74889]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:02:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad (non-flash)
Nov 10 12:02:11 user nova-compute[74889]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:02:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a27e3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad'): ({'sdc'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Removing single pathed devices sdc {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[176821f7-fc57-4c95-907b-ab761d814e3f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cf58e7-5ec7-4cc0-97ac-d4fa78878b9e]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Flushing IO for device /dev/sdc {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79fdcc3-9e5a-4686-9162-9e7cb3c9b6e6]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfc63a2-ddc3-48d2-8b50-ac5f7c4df516]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ff6c44-419e-4fc0-8382-375473802f85]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:02:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1c96d5-b77a-47b8-ab9d-351d5abcbafa]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260]
Nov 10 12:02:12 user nova-compute[74889]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad, portal: 172.16.0.220,3260] successful.
Nov 10 12:02:12 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:02:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4eb06668-3486-48c6-9f64-1df49ce73aad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1262e9-ba1b-424c-9f31-dbae5aa49350]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:02:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:02:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] <== disconnect_volume: return (277ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:02:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:02:13 user nova-compute[74889]: DEBUG nova.objects.instance [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'flavor' on Instance uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:02:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-473b1f11-7270-4498-a7a0-8bc73d8727af tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.917s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:02:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:02:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:02:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:02:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:20 user nova-compute[74889]: INFO nova.compute.manager [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Terminating instance
Nov 10 12:02:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:02:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-08447ba9-30df-409c-8fe7-bb67c70b3091 req-53319be9-ef6f-4be4-954a-1613108aeb26 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Received event network-vif-unplugged-1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-08447ba9-30df-409c-8fe7-bb67c70b3091 req-53319be9-ef6f-4be4-954a-1613108aeb26 service nova] Acquiring lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-08447ba9-30df-409c-8fe7-bb67c70b3091 req-53319be9-ef6f-4be4-954a-1613108aeb26 service nova] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-08447ba9-30df-409c-8fe7-bb67c70b3091 req-53319be9-ef6f-4be4-954a-1613108aeb26 service nova] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-08447ba9-30df-409c-8fe7-bb67c70b3091 req-53319be9-ef6f-4be4-954a-1613108aeb26 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] No waiting events found dispatching network-vif-unplugged-1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-08447ba9-30df-409c-8fe7-bb67c70b3091 req-53319be9-ef6f-4be4-954a-1613108aeb26 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Received event network-vif-unplugged-1aba17bd-57de-474a-b481-afaacef1d16e for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:02:21 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Instance destroyed successfully.
Nov 10 12:02:21 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lazy-loading 'resources' on Instance uuid ef39ec05-9c6e-4f3f-9881-8777f72073a4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:00:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-344797124',display_name='tempest-ServersNegativeTestJSON-server-344797124',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-344797124',id=21,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:00:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e625bfb83b44435db8d8935883a7995f',ramdisk_id='',reservation_id='r-008iv0ho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1939998126',owner_user_name='tempest-ServersNegativeTestJSON-1939998126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:00:37Z,user_data=None,user_id='aa5f0e22f91049d6ae70a72bc14df5c7',uuid=ef39ec05-9c6e-4f3f-9881-8777f72073a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1aba17bd-57de-474a-b481-afaacef1d16e", "address": "fa:16:3e:e1:a8:ff", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aba17bd-57", "ovs_interfaceid": "1aba17bd-57de-474a-b481-afaacef1d16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converting VIF {"id": "1aba17bd-57de-474a-b481-afaacef1d16e", "address": "fa:16:3e:e1:a8:ff", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1aba17bd-57", "ovs_interfaceid": "1aba17bd-57de-474a-b481-afaacef1d16e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=1aba17bd-57de-474a-b481-afaacef1d16e,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aba17bd-57') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG os_vif [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=1aba17bd-57de-474a-b481-afaacef1d16e,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aba17bd-57') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1aba17bd-57, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1449408-8d1e-4e6c-8ab2-e60bef7fadcc) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:21 user nova-compute[74889]: INFO os_vif [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:a8:ff,bridge_name='br-int',has_traffic_filtering=True,id=1aba17bd-57de-474a-b481-afaacef1d16e,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1aba17bd-57')
Nov 10 12:02:21 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Deleting instance files /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4_del
Nov 10 12:02:21 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Deletion of /opt/stack/data/nova/instances/ef39ec05-9c6e-4f3f-9881-8777f72073a4_del complete
Nov 10 12:02:21 user nova-compute[74889]: INFO nova.compute.manager [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 10 12:02:21 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:02:21 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:02:22 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:22 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Took 0.62 seconds to deallocate network for instance.
Nov 10 12:02:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:22 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:02:22 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:02:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:22 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Deleted allocations for instance ef39ec05-9c6e-4f3f-9881-8777f72073a4
Nov 10 12:02:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ffa86029-82aa-4558-87bd-48b37fc505c8 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.763s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-58524062-686e-4275-8659-10625e6022f6 req-6a8e3b3e-6e17-4483-8c61-629f12b5e693 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Received event network-vif-plugged-1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-58524062-686e-4275-8659-10625e6022f6 req-6a8e3b3e-6e17-4483-8c61-629f12b5e693 service nova] Acquiring lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-58524062-686e-4275-8659-10625e6022f6 req-6a8e3b3e-6e17-4483-8c61-629f12b5e693 service nova] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-58524062-686e-4275-8659-10625e6022f6 req-6a8e3b3e-6e17-4483-8c61-629f12b5e693 service nova] Lock "ef39ec05-9c6e-4f3f-9881-8777f72073a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-58524062-686e-4275-8659-10625e6022f6 req-6a8e3b3e-6e17-4483-8c61-629f12b5e693 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] No waiting events found dispatching network-vif-plugged-1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:23 user nova-compute[74889]: WARNING nova.compute.manager [req-58524062-686e-4275-8659-10625e6022f6 req-6a8e3b3e-6e17-4483-8c61-629f12b5e693 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Received unexpected event network-vif-plugged-1aba17bd-57de-474a-b481-afaacef1d16e for instance with vm_state deleted and task_state None.
Nov 10 12:02:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-58524062-686e-4275-8659-10625e6022f6 req-6a8e3b3e-6e17-4483-8c61-629f12b5e693 service nova] [instance: ef39ec05-9c6e-4f3f-9881-8777f72073a4] Received event network-vif-deleted-1aba17bd-57de-474a-b481-afaacef1d16e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:02:24 user nova-compute[74889]: INFO nova.compute.claims [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Claim successful on node user
Nov 10 12:02:24 user nova-compute[74889]: DEBUG nova.compute.manager [req-e6e24240-fb25-44b0-a0ce-a4ee9ca8dc6c req-992d6a0c-8492-42a1-8d79-6f8153687a99 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received event network-changed-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG nova.compute.manager [req-e6e24240-fb25-44b0-a0ce-a4ee9ca8dc6c req-992d6a0c-8492-42a1-8d79-6f8153687a99 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Refreshing instance network info cache due to event network-changed-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e6e24240-fb25-44b0-a0ce-a4ee9ca8dc6c req-992d6a0c-8492-42a1-8d79-6f8153687a99 service nova] Acquiring lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e6e24240-fb25-44b0-a0ce-a4ee9ca8dc6c req-992d6a0c-8492-42a1-8d79-6f8153687a99 service nova] Acquired lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG nova.network.neutron [req-e6e24240-fb25-44b0-a0ce-a4ee9ca8dc6c req-992d6a0c-8492-42a1-8d79-6f8153687a99 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Refreshing network info cache for port b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:24 user nova-compute[74889]: INFO nova.compute.manager [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Terminating instance
Nov 10 12:02:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:02:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:02:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.network.neutron [req-e6e24240-fb25-44b0-a0ce-a4ee9ca8dc6c req-992d6a0c-8492-42a1-8d79-6f8153687a99 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updated VIF entry in instance network info cache for port b40bb580-99e7-4ca8-a45e-cd332d4e4cd7. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.network.neutron [req-e6e24240-fb25-44b0-a0ce-a4ee9ca8dc6c req-992d6a0c-8492-42a1-8d79-6f8153687a99 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updating instance_info_cache with network_info: [{"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e6e24240-fb25-44b0-a0ce-a4ee9ca8dc6c req-992d6a0c-8492-42a1-8d79-6f8153687a99 service nova] Releasing lock "refresh_cache-6200554d-5be6-48b4-90e9-4151006d8ce3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:02:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Creating image(s)
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "/opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "/opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "/opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.policy [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9dd24986fbd2446dbb8f5fbc7edb1757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeabeb4c529647f296feb83801c04f34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Instance destroyed successfully.
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.objects.instance [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lazy-loading 'resources' on Instance uuid 6200554d-5be6-48b4-90e9-4151006d8ce3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-383015866',display_name='tempest-TestStampPattern-server-383015866',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-383015866',id=8,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxDwFs0AGsEtr15Zi6x2wsIDGQYgbiQSBAGO7YjoF8bCXJVpt9lKEMaMnjKkVdYpvjgsEv3fRCgW9Gc/EdEP0DEjX5Wcf4b9A5MJqJw73kiAjUo/ElWA2D+2WH2oMrVxQ==',key_name='tempest-TestStampPattern-81644911',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:54:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cde601a6b8e24d988c49013a8fe6f0fb',ramdisk_id='',reservation_id='r-0jx31zn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1182113080',owner_user_name='tempest-TestStampPattern-1182113080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:57:53Z,user_data=None,user_id='0713f019fd484ce58496c9038295dad3',uuid=6200554d-5be6-48b4-90e9-4151006d8ce3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converting VIF {"id": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "address": "fa:16:3e:3f:30:b8", "network": {"id": "28d613b8-98e1-4af6-9c7f-7b64f8c719f0", "bridge": "br-int", "label": "tempest-TestStampPattern-1317566632-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cde601a6b8e24d988c49013a8fe6f0fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb40bb580-99", "ovs_interfaceid": "b40bb580-99e7-4ca8-a45e-cd332d4e4cd7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:30:b8,bridge_name='br-int',has_traffic_filtering=True,id=b40bb580-99e7-4ca8-a45e-cd332d4e4cd7,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40bb580-99') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG os_vif [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:30:b8,bridge_name='br-int',has_traffic_filtering=True,id=b40bb580-99e7-4ca8-a45e-cd332d4e4cd7,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40bb580-99') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb40bb580-99, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=929dd640-60ba-4e93-916e-0837cbaa78de) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:25 user nova-compute[74889]: INFO os_vif [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:30:b8,bridge_name='br-int',has_traffic_filtering=True,id=b40bb580-99e7-4ca8-a45e-cd332d4e4cd7,network=Network(28d613b8-98e1-4af6-9c7f-7b64f8c719f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb40bb580-99')
Nov 10 12:02:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Deleting instance files /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3_del
Nov 10 12:02:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Deletion of /opt/stack/data/nova/instances/6200554d-5be6-48b4-90e9-4151006d8ce3_del complete
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk 1073741824" returned: 0 in 0.064s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:25 user nova-compute[74889]: INFO nova.compute.manager [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 10 12:02:25 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:02:25 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Successfully created port: 4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Cannot resize image /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Ensure instance console log exists: /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:26 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Took 0.68 seconds to deallocate network for instance.
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-c2a5984e-ba28-477f-8ac4-1b973b294763 req-6405b383-6bce-42c0-8516-84b4be3db204 service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received event network-vif-deleted-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received event network-vif-unplugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] No waiting events found dispatching network-vif-unplugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received event network-vif-unplugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received event network-vif-plugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] Acquiring lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] No waiting events found dispatching network-vif-plugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:26 user nova-compute[74889]: WARNING nova.compute.manager [req-39aebe8c-a889-4c4a-a1f4-467307d61110 req-65665ef8-4caf-4fe5-b3ad-3585d499b41e service nova] [instance: 6200554d-5be6-48b4-90e9-4151006d8ce3] Received unexpected event network-vif-plugged-b40bb580-99e7-4ca8-a45e-cd332d4e4cd7 for instance with vm_state active and task_state deleting.
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:02:26 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:27 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Deleted allocations for instance 6200554d-5be6-48b4-90e9-4151006d8ce3
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Successfully updated port: 4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-11084109-d48d-498e-bad1-0b9001d3eb2c tempest-TestStampPattern-1182113080 tempest-TestStampPattern-1182113080-project-member] Lock "6200554d-5be6-48b4-90e9-4151006d8ce3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.483s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquired lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-c750cf47-25e1-4a1e-a87a-5f361812978e req-f601c736-c4c6-4f1e-a1fc-67c1e16caef9 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-changed-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-c750cf47-25e1-4a1e-a87a-5f361812978e req-f601c736-c4c6-4f1e-a1fc-67c1e16caef9 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Refreshing instance network info cache due to event network-changed-4ceb9d41-aad6-4ed3-8b12-50413fabe32d. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c750cf47-25e1-4a1e-a87a-5f361812978e req-f601c736-c4c6-4f1e-a1fc-67c1e16caef9 service nova] Acquiring lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updating instance_info_cache with network_info: [{"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Releasing lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Instance network_info: |[{"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c750cf47-25e1-4a1e-a87a-5f361812978e req-f601c736-c4c6-4f1e-a1fc-67c1e16caef9 service nova] Acquired lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.network.neutron [req-c750cf47-25e1-4a1e-a87a-5f361812978e req-f601c736-c4c6-4f1e-a1fc-67c1e16caef9 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Refreshing network info cache for port 4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Start _get_guest_xml network_info=[{"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:02:27 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:02:27 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-547757369',display_name='tempest-AttachVolumeTestJSON-server-547757369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-547757369',id=23,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXxmHL5QVe+PvfGtjBG9i2g71uxXB9DHwvOoAdzQXj/RxzB4fgUBQNm/qChjoqMXRb2A2vbJC3MSzJ3tSbPAIUV0SZ6MWHE4m6rhUWWCNp+g3dXt/+RxoxZ6XKsfzokhg==',key_name='tempest-keypair-1845325555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-3z41f0cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:02:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=b11fa594-7afe-4454-bbc2-e68a3564500e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=4ceb9d41-aad6-4ed3-8b12-50413fabe32d,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb9d41-aa') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.objects.instance [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'pci_devices' on Instance uuid b11fa594-7afe-4454-bbc2-e68a3564500e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:02:27 user nova-compute[74889]:   <uuid>b11fa594-7afe-4454-bbc2-e68a3564500e</uuid>
Nov 10 12:02:27 user nova-compute[74889]:   <name>instance-00000017</name>
Nov 10 12:02:27 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:02:27 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:02:27 user nova-compute[74889]:   <metadata>
Nov 10 12:02:27 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:02:27 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:02:27 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeTestJSON-server-547757369</nova:name>
Nov 10 12:02:27 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:02:27</nova:creationTime>
Nov 10 12:02:27 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:02:27 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:02:27 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:02:27 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:02:27 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:02:27 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:02:27 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:02:27 user nova-compute[74889]:       <nova:owner>
Nov 10 12:02:27 user nova-compute[74889]:         <nova:user uuid="9dd24986fbd2446dbb8f5fbc7edb1757">tempest-AttachVolumeTestJSON-1611590837-project-member</nova:user>
Nov 10 12:02:27 user nova-compute[74889]:         <nova:project uuid="eeabeb4c529647f296feb83801c04f34">tempest-AttachVolumeTestJSON-1611590837</nova:project>
Nov 10 12:02:27 user nova-compute[74889]:       </nova:owner>
Nov 10 12:02:27 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:02:27 user nova-compute[74889]:       <nova:ports>
Nov 10 12:02:27 user nova-compute[74889]:         <nova:port uuid="4ceb9d41-aad6-4ed3-8b12-50413fabe32d">
Nov 10 12:02:27 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 12:02:27 user nova-compute[74889]:         </nova:port>
Nov 10 12:02:27 user nova-compute[74889]:       </nova:ports>
Nov 10 12:02:27 user nova-compute[74889]:     </nova:instance>
Nov 10 12:02:27 user nova-compute[74889]:   </metadata>
Nov 10 12:02:27 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:02:27 user nova-compute[74889]:     <system>
Nov 10 12:02:27 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:02:27 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:02:27 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:02:27 user nova-compute[74889]:       <entry name="serial">b11fa594-7afe-4454-bbc2-e68a3564500e</entry>
Nov 10 12:02:27 user nova-compute[74889]:       <entry name="uuid">b11fa594-7afe-4454-bbc2-e68a3564500e</entry>
Nov 10 12:02:27 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:02:27 user nova-compute[74889]:     </system>
Nov 10 12:02:27 user nova-compute[74889]:   </sysinfo>
Nov 10 12:02:27 user nova-compute[74889]:   <os>
Nov 10 12:02:27 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:02:27 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:02:27 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:02:27 user nova-compute[74889]:   </os>
Nov 10 12:02:27 user nova-compute[74889]:   <features>
Nov 10 12:02:27 user nova-compute[74889]:     <acpi/>
Nov 10 12:02:27 user nova-compute[74889]:     <apic/>
Nov 10 12:02:27 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:02:27 user nova-compute[74889]:   </features>
Nov 10 12:02:27 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:02:27 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:02:27 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:02:27 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:02:27 user nova-compute[74889]:   </clock>
Nov 10 12:02:27 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:02:27 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:02:27 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:02:27 user nova-compute[74889]:   </cpu>
Nov 10 12:02:27 user nova-compute[74889]:   <devices>
Nov 10 12:02:27 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:02:27 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:02:27 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk"/>
Nov 10 12:02:27 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:02:27 user nova-compute[74889]:     </disk>
Nov 10 12:02:27 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:02:27 user nova-compute[74889]:       <mac address="fa:16:3e:b1:11:4a"/>
Nov 10 12:02:27 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:02:27 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:02:27 user nova-compute[74889]:       <target dev="tap4ceb9d41-aa"/>
Nov 10 12:02:27 user nova-compute[74889]:     </interface>
Nov 10 12:02:27 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:02:27 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/console.log" append="off"/>
Nov 10 12:02:27 user nova-compute[74889]:     </serial>
Nov 10 12:02:27 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:02:27 user nova-compute[74889]:     <video>
Nov 10 12:02:27 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:02:27 user nova-compute[74889]:     </video>
Nov 10 12:02:27 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:02:27 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:02:27 user nova-compute[74889]:     </rng>
Nov 10 12:02:27 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:02:27 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:02:27 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:02:27 user nova-compute[74889]:     </memballoon>
Nov 10 12:02:27 user nova-compute[74889]:   </devices>
Nov 10 12:02:27 user nova-compute[74889]: </domain>
Nov 10 12:02:27 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-547757369',display_name='tempest-AttachVolumeTestJSON-server-547757369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-547757369',id=23,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXxmHL5QVe+PvfGtjBG9i2g71uxXB9DHwvOoAdzQXj/RxzB4fgUBQNm/qChjoqMXRb2A2vbJC3MSzJ3tSbPAIUV0SZ6MWHE4m6rhUWWCNp+g3dXt/+RxoxZ6XKsfzokhg==',key_name='tempest-keypair-1845325555',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-3z41f0cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:02:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=b11fa594-7afe-4454-bbc2-e68a3564500e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=4ceb9d41-aad6-4ed3-8b12-50413fabe32d,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb9d41-aa') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG os_vif [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=4ceb9d41-aad6-4ed3-8b12-50413fabe32d,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb9d41-aa') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c8602bf-8ca1-5eaf-800f-a45582c8b519', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ceb9d41-aa, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ceb9d41-aa, col_values=(('qos', UUID('20eb081c-e277-4b71-aeb0-4a0caaf8a33e')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ceb9d41-aa, col_values=(('external_ids', {'iface-id': '4ceb9d41-aad6-4ed3-8b12-50413fabe32d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:11:4a', 'vm-uuid': 'b11fa594-7afe-4454-bbc2-e68a3564500e'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:27 user nova-compute[74889]: INFO os_vif [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=4ceb9d41-aad6-4ed3-8b12-50413fabe32d,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb9d41-aa')
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:02:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No VIF found with MAC fa:16:3e:b1:11:4a, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:02:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-c750cf47-25e1-4a1e-a87a-5f361812978e req-f601c736-c4c6-4f1e-a1fc-67c1e16caef9 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updated VIF entry in instance network info cache for port 4ceb9d41-aad6-4ed3-8b12-50413fabe32d. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:02:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-c750cf47-25e1-4a1e-a87a-5f361812978e req-f601c736-c4c6-4f1e-a1fc-67c1e16caef9 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updating instance_info_cache with network_info: [{"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c750cf47-25e1-4a1e-a87a-5f361812978e req-f601c736-c4c6-4f1e-a1fc-67c1e16caef9 service nova] Releasing lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-0ed11962-a8ec-4b97-b65b-f555ceae2c20 req-963f176f-5cc9-40d8-96f3-7359e15c3a04 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0ed11962-a8ec-4b97-b65b-f555ceae2c20 req-963f176f-5cc9-40d8-96f3-7359e15c3a04 service nova] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0ed11962-a8ec-4b97-b65b-f555ceae2c20 req-963f176f-5cc9-40d8-96f3-7359e15c3a04 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0ed11962-a8ec-4b97-b65b-f555ceae2c20 req-963f176f-5cc9-40d8-96f3-7359e15c3a04 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-0ed11962-a8ec-4b97-b65b-f555ceae2c20 req-963f176f-5cc9-40d8-96f3-7359e15c3a04 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] No waiting events found dispatching network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:29 user nova-compute[74889]: WARNING nova.compute.manager [req-0ed11962-a8ec-4b97-b65b-f555ceae2c20 req-963f176f-5cc9-40d8-96f3-7359e15c3a04 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received unexpected event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d for instance with vm_state building and task_state spawning.
Nov 10 12:02:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:02:31 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Instance spawned successfully.
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-20876b5a-50b9-42ee-910b-10e8c9d08567 req-096b834f-8f44-482b-93e3-438ab531cf7a service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-20876b5a-50b9-42ee-910b-10e8c9d08567 req-096b834f-8f44-482b-93e3-438ab531cf7a service nova] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-20876b5a-50b9-42ee-910b-10e8c9d08567 req-096b834f-8f44-482b-93e3-438ab531cf7a service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-20876b5a-50b9-42ee-910b-10e8c9d08567 req-096b834f-8f44-482b-93e3-438ab531cf7a service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-20876b5a-50b9-42ee-910b-10e8c9d08567 req-096b834f-8f44-482b-93e3-438ab531cf7a service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] No waiting events found dispatching network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:31 user nova-compute[74889]: WARNING nova.compute.manager [req-20876b5a-50b9-42ee-910b-10e8c9d08567 req-096b834f-8f44-482b-93e3-438ab531cf7a service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received unexpected event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d for instance with vm_state building and task_state spawning.
Nov 10 12:02:31 user nova-compute[74889]: INFO nova.compute.manager [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 10 12:02:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:02:31 user nova-compute[74889]: INFO nova.compute.manager [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Took 7.45 seconds to build instance.
Nov 10 12:02:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-cf0bb09a-675e-4a12-8d5b-1c9cc6f5a0c6 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.558s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:32 user nova-compute[74889]: INFO nova.compute.manager [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Unshelving
Nov 10 12:02:33 user nova-compute[74889]: INFO nova.virt.block_device [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Booting with volume e9f23384-8a98-40fd-af08-babb064b0c5a at /dev/vda
Nov 10 12:02:33 user nova-compute[74889]: DEBUG os_brick.utils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[db39f046-2e10-49ac-8353-8e30730cc198]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d646d45-ae24-4b64-a04a-6e15027c4e08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[80015236-300b-4b4f-b653-534f199702f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b90223-9e9f-4ee7-84de-7c7b5577a775]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:02:33 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:02:33 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6871c7-4118-46fa-b979-e6dcdeb8c8bd]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG os_brick.utils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:02:33 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating existing volume attachment record: 6f4ea910-f361-45bc-9254-cfed0607601a {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:02:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:38 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:02:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:40 user nova-compute[74889]: INFO nova.compute.manager [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Terminating instance
Nov 10 12:02:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-036b9c72-1659-4f3f-863d-d46cd85b16e9 req-04000c57-d2cd-479b-b03e-afa96bbd9b0f service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received event network-vif-unplugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-036b9c72-1659-4f3f-863d-d46cd85b16e9 req-04000c57-d2cd-479b-b03e-afa96bbd9b0f service nova] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-036b9c72-1659-4f3f-863d-d46cd85b16e9 req-04000c57-d2cd-479b-b03e-afa96bbd9b0f service nova] Lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-036b9c72-1659-4f3f-863d-d46cd85b16e9 req-04000c57-d2cd-479b-b03e-afa96bbd9b0f service nova] Lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-036b9c72-1659-4f3f-863d-d46cd85b16e9 req-04000c57-d2cd-479b-b03e-afa96bbd9b0f service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] No waiting events found dispatching network-vif-unplugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-036b9c72-1659-4f3f-863d-d46cd85b16e9 req-04000c57-d2cd-479b-b03e-afa96bbd9b0f service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received event network-vif-unplugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Instance destroyed successfully.
Nov 10 12:02:40 user nova-compute[74889]: DEBUG nova.objects.instance [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lazy-loading 'resources' on Instance uuid 61077e59-6249-4a6e-b749-733ed9735bb2 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-334584636',display_name='tempest-VolumesAdminNegativeTest-server-334584636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-334584636',id=11,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH0CR8juMjTeJIa38UPLor6e8vvtvsVJ8AUm9XirzmjX31zD8KQdFkm+BKMngPY2Bx6lKGDAIFV23Dwra3h3q890WkkMHBl6DX1dtxzfcvsTFr62pTybPdx0EWt+6Wu6w==',key_name='tempest-keypair-335841088',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74f4a33c330842ba9dca41b5a174a07d',ramdisk_id='',reservation_id='r-tleex7z6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-35604331',owner_user_name='tempest-VolumesAdminNegativeTest-35604331-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d028f217bd5b4a3994139d537c623bc5',uuid=61077e59-6249-4a6e-b749-733ed9735bb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converting VIF {"id": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "address": "fa:16:3e:69:9b:10", "network": {"id": "8c0090a2-fb4f-40e7-941a-9aedca0d9f9b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1371576294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f4a33c330842ba9dca41b5a174a07d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea862be1-a0", "ovs_interfaceid": "ea862be1-a0e1-4e74-9464-9cfb4201f611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=ea862be1-a0e1-4e74-9464-9cfb4201f611,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea862be1-a0') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG os_vif [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=ea862be1-a0e1-4e74-9464-9cfb4201f611,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea862be1-a0') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea862be1-a0, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fcb2022-fb73-415e-8bf1-a02d924292fc) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:02:40 user nova-compute[74889]: INFO os_vif [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:9b:10,bridge_name='br-int',has_traffic_filtering=True,id=ea862be1-a0e1-4e74-9464-9cfb4201f611,network=Network(8c0090a2-fb4f-40e7-941a-9aedca0d9f9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea862be1-a0')
Nov 10 12:02:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Deleting instance files /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2_del
Nov 10 12:02:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Deletion of /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2_del complete
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json" returned: 1 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk --force-share --output=json' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:02:41 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000000b, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/61077e59-6249-4a6e-b749-733ed9735bb2/disk
Nov 10 12:02:41 user nova-compute[74889]: INFO nova.compute.manager [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:42 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:42 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Took 1.35 seconds to deallocate network for instance.
Nov 10 12:02:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3a1f10b-ff26-4cfc-85dd-050502a81c1d req-dd2df1f3-d798-4641-8888-63d028ae66d5 service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received event network-vif-plugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3a1f10b-ff26-4cfc-85dd-050502a81c1d req-dd2df1f3-d798-4641-8888-63d028ae66d5 service nova] Acquiring lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3a1f10b-ff26-4cfc-85dd-050502a81c1d req-dd2df1f3-d798-4641-8888-63d028ae66d5 service nova] Lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3a1f10b-ff26-4cfc-85dd-050502a81c1d req-dd2df1f3-d798-4641-8888-63d028ae66d5 service nova] Lock "61077e59-6249-4a6e-b749-733ed9735bb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3a1f10b-ff26-4cfc-85dd-050502a81c1d req-dd2df1f3-d798-4641-8888-63d028ae66d5 service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] No waiting events found dispatching network-vif-plugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:42 user nova-compute[74889]: WARNING nova.compute.manager [req-e3a1f10b-ff26-4cfc-85dd-050502a81c1d req-dd2df1f3-d798-4641-8888-63d028ae66d5 service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received unexpected event network-vif-plugged-ea862be1-a0e1-4e74-9464-9cfb4201f611 for instance with vm_state active and task_state deleting.
Nov 10 12:02:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-c324f4cc-1689-4545-8d42-22e39e90314f req-f8953d52-0a68-4b79-9bcb-350a213758ed service nova] [instance: 61077e59-6249-4a6e-b749-733ed9735bb2] Received event network-vif-deleted-ea862be1-a0e1-4e74-9464-9cfb4201f611 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:43 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:02:43 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:02:43 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7815MB free_disk=25.467239379882812GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Refreshing inventories for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Updating ProviderTree inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Refreshing aggregate associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, aggregates: None {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Refreshing trait associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.864s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.850s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:43 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Deleted allocations for instance 61077e59-6249-4a6e-b749-733ed9735bb2
Nov 10 12:02:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b7632671-0794-416a-a3b1-0f0d440fffc2 tempest-VolumesAdminNegativeTest-35604331 tempest-VolumesAdminNegativeTest-35604331-project-member] Lock "61077e59-6249-4a6e-b749-733ed9735bb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.037s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 93367290-6fa4-4bbe-b47b-2dfa27227bed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 22718082-4c44-4384-8692-c216bb1a14e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance b11fa594-7afe-4454-bbc2-e68a3564500e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 78fe06d2-9353-4b9a-8e34-2261f2f77fce has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-2423ebe3-3000-4463-a78f-9e9e6ca4b7c3 req-20419102-bdc9-4de6-9cba-5ece1ebb5573 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-changed-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-2423ebe3-3000-4463-a78f-9e9e6ca4b7c3 req-20419102-bdc9-4de6-9cba-5ece1ebb5573 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Refreshing instance network info cache due to event network-changed-48bc9f95-bf34-4076-b2cc-f42c55031c09. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2423ebe3-3000-4463-a78f-9e9e6ca4b7c3 req-20419102-bdc9-4de6-9cba-5ece1ebb5573 service nova] Acquiring lock "refresh_cache-44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2423ebe3-3000-4463-a78f-9e9e6ca4b7c3 req-20419102-bdc9-4de6-9cba-5ece1ebb5573 service nova] Acquired lock "refresh_cache-44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.network.neutron [req-2423ebe3-3000-4463-a78f-9e9e6ca4b7c3 req-20419102-bdc9-4de6-9cba-5ece1ebb5573 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Refreshing network info cache for port 48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:44 user nova-compute[74889]: INFO nova.compute.manager [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Terminating instance
Nov 10 12:02:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Skipping network cache update for instance because it is being deleted. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid 19d4137a-5cdf-42d1-8846-35813d6360f6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Instance destroyed successfully.
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'resources' on Instance uuid 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1467866079',display_name='tempest-AttachVolumeNegativeTest-server-1467866079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1467866079',id=22,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYAg/9w7gBTZdiTejRLbLCJ+Elw5JnBgXD3iLN2qmd3vfI58OZg1xu2+tyqouGxTEvr2YgtE+nwwkpAvegjgXyzVCRZcw1sDlj/tELJNE5gWukTdMcKzvqCwagDD9mMAQ==',key_name='tempest-keypair-537571039',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:00:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-ard1l2mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=48bc9f95-bf34-4076-b2cc-f42c55031c09,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bc9f95-bf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG os_vif [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=48bc9f95-bf34-4076-b2cc-f42c55031c09,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bc9f95-bf') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48bc9f95-bf, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57e016dc-ead1-4614-ad49-f15c1f20bc80) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:02:45 user nova-compute[74889]: INFO os_vif [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=48bc9f95-bf34-4076-b2cc-f42c55031c09,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48bc9f95-bf')
Nov 10 12:02:45 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Deleting instance files /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02_del
Nov 10 12:02:45 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Deletion of /opt/stack/data/nova/instances/44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02_del complete
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:45 user nova-compute[74889]: INFO nova.compute.manager [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 10 12:02:45 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:02:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-2423ebe3-3000-4463-a78f-9e9e6ca4b7c3 req-20419102-bdc9-4de6-9cba-5ece1ebb5573 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Updated VIF entry in instance network info cache for port 48bc9f95-bf34-4076-b2cc-f42c55031c09. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-2423ebe3-3000-4463-a78f-9e9e6ca4b7c3 req-20419102-bdc9-4de6-9cba-5ece1ebb5573 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Updating instance_info_cache with network_info: [{"id": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "address": "fa:16:3e:b5:cf:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48bc9f95-bf", "ovs_interfaceid": "48bc9f95-bf34-4076-b2cc-f42c55031c09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2423ebe3-3000-4463-a78f-9e9e6ca4b7c3 req-20419102-bdc9-4de6-9cba-5ece1ebb5573 service nova] Releasing lock "refresh_cache-44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-vif-unplugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] No waiting events found dispatching network-vif-unplugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-vif-unplugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] No waiting events found dispatching network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:46 user nova-compute[74889]: WARNING nova.compute.manager [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received unexpected event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 for instance with vm_state active and task_state deleting.
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] No waiting events found dispatching network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:46 user nova-compute[74889]: WARNING nova.compute.manager [req-618132d6-f536-4c2c-b010-9f762bce3f25 req-47ee1c62-2790-4fb7-ba0e-666adb12d635 service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received unexpected event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 for instance with vm_state active and task_state deleting.
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updating instance_info_cache with network_info: [{"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:02:46 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:02:47 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:02:47 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:02:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:47 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:02:47 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Took 1.75 seconds to deallocate network for instance.
Nov 10 12:02:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-fde6077a-0015-4b12-a49c-b3a5c03fe1e4 req-03cc1e7b-7fc2-43d8-9ca1-01c53e363f8c service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-vif-deleted-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.345s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:02:48 user nova-compute[74889]: INFO nova.compute.claims [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Claim successful on node user
Nov 10 12:02:48 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Deleted allocations for instance 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f4ba1b3a-144f-4545-9352-326cb7c742a3 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.352s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.network.neutron [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:02:48 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.policy [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f4638ca003c46dab10aab2e5a2e6fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '688cad5e5288440bb533d6e2c2f764c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:02:48 user nova-compute[74889]: INFO nova.virt.block_device [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Booting with volume 13562062-f66e-40d1-8de7-ef2d8d90ff7b at /dev/vda
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] No waiting events found dispatching network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:48 user nova-compute[74889]: WARNING nova.compute.manager [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received unexpected event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 for instance with vm_state deleted and task_state None.
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-vif-unplugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] No waiting events found dispatching network-vif-unplugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:48 user nova-compute[74889]: WARNING nova.compute.manager [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received unexpected event network-vif-unplugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 for instance with vm_state deleted and task_state None.
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] Acquiring lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] Lock "44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] No waiting events found dispatching network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:48 user nova-compute[74889]: WARNING nova.compute.manager [req-026318f3-44e8-4f41-8911-7695718f415b req-7f5d74e7-9bcc-4a4d-a571-7e9395707beb service nova] [instance: 44a7aca2-fb4a-4cf8-8d29-c9ef3ecffa02] Received unexpected event network-vif-plugged-48bc9f95-bf34-4076-b2cc-f42c55031c09 for instance with vm_state deleted and task_state None.
Nov 10 12:02:48 user nova-compute[74889]: DEBUG os_brick.utils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a93b8a0-0ed8-484f-a7c0-aea01173bc58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[913f0b01-7408-4468-8dd9-dedcd0fe5afb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5106b9b5-a62d-4073-8333-547ae18d7ce8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7060899-8414-4d55-a73c-8a163aa2074b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:02:48 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:02:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec1325-8163-4f50-9f8a-72f0ed9f990f]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG os_brick.utils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:02:48 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating existing volume attachment record: 2c83bc25-4316-4353-92d9-2199229634cf {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:02:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:49 user nova-compute[74889]: DEBUG nova.network.neutron [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Successfully created port: ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:02:49 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:02:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:02:49 user nova-compute[74889]: DEBUG nova.network.neutron [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Successfully updated port: ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquired lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG nova.network.neutron [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-8a1e337e-3325-4732-9fe3-b6d6c64b64b4 req-195a923c-6849-4de9-bc0d-b9f53342c364 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-changed-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-8a1e337e-3325-4732-9fe3-b6d6c64b64b4 req-195a923c-6849-4de9-bc0d-b9f53342c364 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Refreshing instance network info cache due to event network-changed-ab97e0c2-49c1-4812-b8c5-ede04531a6f0. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8a1e337e-3325-4732-9fe3-b6d6c64b64b4 req-195a923c-6849-4de9-bc0d-b9f53342c364 service nova] Acquiring lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG nova.network.neutron [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG nova.network.neutron [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating instance_info_cache with network_info: [{"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Releasing lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Instance network_info: |[{"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8a1e337e-3325-4732-9fe3-b6d6c64b64b4 req-195a923c-6849-4de9-bc0d-b9f53342c364 service nova] Acquired lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG nova.network.neutron [req-8a1e337e-3325-4732-9fe3-b6d6c64b64b4 req-195a923c-6849-4de9-bc0d-b9f53342c364 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Refreshing network info cache for port ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG nova.network.neutron [req-8a1e337e-3325-4732-9fe3-b6d6c64b64b4 req-195a923c-6849-4de9-bc0d-b9f53342c364 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updated VIF entry in instance network info cache for port ab97e0c2-49c1-4812-b8c5-ede04531a6f0. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG nova.network.neutron [req-8a1e337e-3325-4732-9fe3-b6d6c64b64b4 req-195a923c-6849-4de9-bc0d-b9f53342c364 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating instance_info_cache with network_info: [{"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8a1e337e-3325-4732-9fe3-b6d6c64b64b4 req-195a923c-6849-4de9-bc0d-b9f53342c364 service nova] Releasing lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:02:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:55 user nova-compute[74889]: INFO nova.compute.manager [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Terminating instance
Nov 10 12:02:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG nova.compute.manager [req-72567043-a428-4f5c-98fd-2e6a5842a762 req-3894f69c-9a28-4b21-b2f0-b834c6966a51 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-vif-unplugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-72567043-a428-4f5c-98fd-2e6a5842a762 req-3894f69c-9a28-4b21-b2f0-b834c6966a51 service nova] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-72567043-a428-4f5c-98fd-2e6a5842a762 req-3894f69c-9a28-4b21-b2f0-b834c6966a51 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-72567043-a428-4f5c-98fd-2e6a5842a762 req-3894f69c-9a28-4b21-b2f0-b834c6966a51 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG nova.compute.manager [req-72567043-a428-4f5c-98fd-2e6a5842a762 req-3894f69c-9a28-4b21-b2f0-b834c6966a51 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] No waiting events found dispatching network-vif-unplugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG nova.compute.manager [req-72567043-a428-4f5c-98fd-2e6a5842a762 req-3894f69c-9a28-4b21-b2f0-b834c6966a51 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-vif-unplugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:55 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Instance destroyed successfully.
Nov 10 12:02:55 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'resources' on Instance uuid 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:56:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1245126454',display_name='tempest-TestMinimumBasicScenario-server-1245126454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1245126454',id=13,image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7GZ41ZWNzFvBcWtC9GTpFVqgVYTBFqi084aaLambFMQNgXoeTPHI9MF8shzD+xmyYsSreQCj75/9GnV0q5V1LN3QXUdTI2poyQnKSwe5JoSZ5kbu3SuKCJK8NqZeSD3A==',key_name='tempest-TestMinimumBasicScenario-482704221',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:57:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1298008035034b9ea352dc01af38a417',ramdisk_id='',reservation_id='r-0vx1c0zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='67949d31-8d59-4baf-9c85-11bad7396a97',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1750479142',owner_user_name='tempest-TestMinimumBasicScenario-1750479142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:00:06Z,user_data=None,user_id='f59a12b24b02408e9602dd7146453a57',uuid=51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converting VIF {"id": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "address": "fa:16:3e:fe:b2:5b", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37d0a738-3b", "ovs_interfaceid": "37d0a738-3b02-4291-90e6-20f0a0215ab9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:02:55 user nova-compute[74889]: DEBUG os_vif [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37d0a738-3b, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6753e733-1e4f-45ac-9b9b-81188d734719) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:02:56 user nova-compute[74889]: INFO os_vif [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b2:5b,bridge_name='br-int',has_traffic_filtering=True,id=37d0a738-3b02-4291-90e6-20f0a0215ab9,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37d0a738-3b')
Nov 10 12:02:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Deleting instance files /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b_del
Nov 10 12:02:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Deletion of /opt/stack/data/nova/instances/51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b_del complete
Nov 10 12:02:56 user nova-compute[74889]: INFO nova.compute.manager [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 10 12:02:56 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:56 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Took 0.68 seconds to deallocate network for instance.
Nov 10 12:02:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-2a71b97d-b770-49e0-88af-26b8bdc684f6 req-439ebb50-6372-4382-8e1a-cad6fdd11d84 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-vif-deleted-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:56 user nova-compute[74889]: INFO nova.compute.manager [req-2a71b97d-b770-49e0-88af-26b8bdc684f6 req-439ebb50-6372-4382-8e1a-cad6fdd11d84 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Neutron deleted interface 37d0a738-3b02-4291-90e6-20f0a0215ab9; detaching it from the instance and deleting it from the info cache
Nov 10 12:02:56 user nova-compute[74889]: DEBUG nova.network.neutron [req-2a71b97d-b770-49e0-88af-26b8bdc684f6 req-439ebb50-6372-4382-8e1a-cad6fdd11d84 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-2a71b97d-b770-49e0-88af-26b8bdc684f6 req-439ebb50-6372-4382-8e1a-cad6fdd11d84 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Detach interface failed, port_id=37d0a738-3b02-4291-90e6-20f0a0215ab9, reason: Instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:57 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:02:57 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:02:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:57 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Deleted allocations for instance 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b
Nov 10 12:02:57 user nova-compute[74889]: DEBUG nova.compute.manager [req-097f56b2-07c3-4b16-ae61-1973fa08fe86 req-a9a92bed-9efa-4640-8061-ccc41c246b99 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:02:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-097f56b2-07c3-4b16-ae61-1973fa08fe86 req-a9a92bed-9efa-4640-8061-ccc41c246b99 service nova] Acquiring lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:02:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-097f56b2-07c3-4b16-ae61-1973fa08fe86 req-a9a92bed-9efa-4640-8061-ccc41c246b99 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:02:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-097f56b2-07c3-4b16-ae61-1973fa08fe86 req-a9a92bed-9efa-4640-8061-ccc41c246b99 service nova] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:57 user nova-compute[74889]: DEBUG nova.compute.manager [req-097f56b2-07c3-4b16-ae61-1973fa08fe86 req-a9a92bed-9efa-4640-8061-ccc41c246b99 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] No waiting events found dispatching network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:02:57 user nova-compute[74889]: WARNING nova.compute.manager [req-097f56b2-07c3-4b16-ae61-1973fa08fe86 req-a9a92bed-9efa-4640-8061-ccc41c246b99 service nova] [instance: 51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b] Received unexpected event network-vif-plugged-37d0a738-3b02-4291-90e6-20f0a0215ab9 for instance with vm_state deleted and task_state None.
Nov 10 12:02:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9a0b08d8-fef9-49ce-92ab-14445e33f988 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "51ee3dff-76c3-4939-9dfc-e59ee1ae3f7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.390s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:02:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:01 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lazy-loading 'pci_requests' on Instance uuid 78fe06d2-9353-4b9a-8e34-2261f2f77fce {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:03:01 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lazy-loading 'numa_topology' on Instance uuid 78fe06d2-9353-4b9a-8e34-2261f2f77fce {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:03:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:03:01 user nova-compute[74889]: INFO nova.compute.claims [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Claim successful on node user
Nov 10 12:03:02 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:03:02 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:03:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:02 user nova-compute[74889]: INFO nova.network.neutron [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating port cf06308d-3f2e-40e2-b778-561b0c14eea0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 12:03:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:03:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquired lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:03:03 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:03:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-81626f9d-203f-4dc4-b3d3-fe41800a062e req-5b929f27-1263-462b-8a72-fddb26e6e449 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-changed-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:03:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-81626f9d-203f-4dc4-b3d3-fe41800a062e req-5b929f27-1263-462b-8a72-fddb26e6e449 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Refreshing instance network info cache due to event network-changed-cf06308d-3f2e-40e2-b778-561b0c14eea0. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:03:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-81626f9d-203f-4dc4-b3d3-fe41800a062e req-5b929f27-1263-462b-8a72-fddb26e6e449 service nova] Acquiring lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating instance_info_cache with network_info: [{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Releasing lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:03:04 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Creating image(s)
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Ensure instance console log exists: /opt/stack/data/nova/instances/78fe06d2-9353-4b9a-8e34-2261f2f77fce/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Start _get_guest_xml network_info=[{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuiXrEFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78fe06d2-9353-4b9a-8e34-2261f2f77fce', 'attached_at': '', 'detached_at': '', 'volume_id': 'e9f23384-8a98-40fd-af08-babb064b0c5a', 'serial': 'e9f23384-8a98-40fd-af08-babb064b0c5a'}, 'disk_bus': 'virtio', 'attachment_id': '6f4ea910-f361-45bc-9254-cfed0607601a', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-81626f9d-203f-4dc4-b3d3-fe41800a062e req-5b929f27-1263-462b-8a72-fddb26e6e449 service nova] Acquired lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.network.neutron [req-81626f9d-203f-4dc4-b3d3-fe41800a062e req-5b929f27-1263-462b-8a72-fddb26e6e449 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Refreshing network info cache for port cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:03:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:03:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lazy-loading 'vcpu_model' on Instance uuid 78fe06d2-9353-4b9a-8e34-2261f2f77fce {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.objects.base [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Object Instance<78fe06d2-9353-4b9a-8e34-2261f2f77fce> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuiXrEFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:03:04 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:03:04 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:03:04 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08724da-cdc4-470f-9d71-098664ee8ad9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:03:04 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bab885-f211-4b0e-b765-23f3247ac1a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a] added
Nov 10 12:03:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[751578fc-f904-44d8-8960-f3c01c42507f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cb00f6-0d64-4784-b593-aeaa9cd3a061]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NuiXrEFh {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NuiXrEFh" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2be6a27-2253-422b-89f2-8f6a3464ae92]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NuiXrEFh'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.130s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab35588-3ddb-4da3-95a8-4ff5deba771a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[18063d33-ac8c-44d6-8165-3dd6852a3be6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece05b5c-329e-4a28-996a-c8f0e1657439 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:03:04 user nova-compute[74889]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece05b5c-329e-4a28-996a-c8f0e1657439 (non-flash)
Nov 10 12:03:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:03:04 user nova-compute[74889]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece05b5c-329e-4a28-996a-c8f0e1657439 (non-flash)
Nov 10 12:03:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f49cfdd-22d0-4876-8141-460037be31df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260]
Nov 10 12:03:04 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260] successful.
Nov 10 12:03:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cda03c2-adc0-4e25-9d2e-6be2f3d54c6e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebd4a2a-019e-4508-b48a-c9eadc18c2f5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece05b5c-329e-4a28-996a-c8f0e1657439 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:03:04 user nova-compute[74889]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece05b5c-329e-4a28-996a-c8f0e1657439 (non-flash)
Nov 10 12:03:04 user nova-compute[74889]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:03:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:03:04 user nova-compute[74889]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ece05b5c-329e-4a28-996a-c8f0e1657439 (non-flash)
Nov 10 12:03:04 user nova-compute[74889]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:03:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.518s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5e4139-e8eb-4fc7-ab0b-a8cf7a15e2f0]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuiXrEFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.network.neutron [req-81626f9d-203f-4dc4-b3d3-fe41800a062e req-5b929f27-1263-462b-8a72-fddb26e6e449 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updated VIF entry in instance network info cache for port cf06308d-3f2e-40e2-b778-561b0c14eea0. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG nova.network.neutron [req-81626f9d-203f-4dc4-b3d3-fe41800a062e req-5b929f27-1263-462b-8a72-fddb26e6e449 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating instance_info_cache with network_info: [{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:03:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-81626f9d-203f-4dc4-b3d3-fe41800a062e req-5b929f27-1263-462b-8a72-fddb26e6e449 service nova] Releasing lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.571s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] <== connect_volume: return (1573ms) {'type': 'block', 'scsi_wwn': '23561353032626162', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561353032626162', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T11:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1185042267',display_name='tempest-TestShelveInstance-server-1185042267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1185042267',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-551479707',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63ecf83da57e42c893ec51707cc19d00',ramdisk_id='',reservation_id='r-5a4kdpl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1459906128',owner_user_name='tempest-TestShelveInstance-1459906128-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:02:33Z,user_data=None,user_id='02ca978ddde34a69944046e0ca2ad504',uuid=78fe06d2-9353-4b9a-8e34-2261f2f77fce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converting VIF {"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lazy-loading 'pci_devices' on Instance uuid 78fe06d2-9353-4b9a-8e34-2261f2f77fce {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.objects.base [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Object Instance<78fe06d2-9353-4b9a-8e34-2261f2f77fce> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:03:05 user nova-compute[74889]:   <uuid>78fe06d2-9353-4b9a-8e34-2261f2f77fce</uuid>
Nov 10 12:03:05 user nova-compute[74889]:   <name>instance-00000012</name>
Nov 10 12:03:05 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:03:05 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:03:05 user nova-compute[74889]:   <metadata>
Nov 10 12:03:05 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:03:05 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:03:05 user nova-compute[74889]:       <nova:name>tempest-TestShelveInstance-server-1185042267</nova:name>
Nov 10 12:03:05 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:03:04</nova:creationTime>
Nov 10 12:03:05 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:03:05 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:03:05 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:03:05 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:03:05 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:03:05 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:03:05 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:03:05 user nova-compute[74889]:       <nova:owner>
Nov 10 12:03:05 user nova-compute[74889]:         <nova:user uuid="02ca978ddde34a69944046e0ca2ad504">tempest-TestShelveInstance-1459906128-project-member</nova:user>
Nov 10 12:03:05 user nova-compute[74889]:         <nova:project uuid="63ecf83da57e42c893ec51707cc19d00">tempest-TestShelveInstance-1459906128</nova:project>
Nov 10 12:03:05 user nova-compute[74889]:       </nova:owner>
Nov 10 12:03:05 user nova-compute[74889]:       <nova:ports>
Nov 10 12:03:05 user nova-compute[74889]:         <nova:port uuid="cf06308d-3f2e-40e2-b778-561b0c14eea0">
Nov 10 12:03:05 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 12:03:05 user nova-compute[74889]:         </nova:port>
Nov 10 12:03:05 user nova-compute[74889]:       </nova:ports>
Nov 10 12:03:05 user nova-compute[74889]:     </nova:instance>
Nov 10 12:03:05 user nova-compute[74889]:   </metadata>
Nov 10 12:03:05 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:03:05 user nova-compute[74889]:     <system>
Nov 10 12:03:05 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:03:05 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:03:05 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:03:05 user nova-compute[74889]:       <entry name="serial">78fe06d2-9353-4b9a-8e34-2261f2f77fce</entry>
Nov 10 12:03:05 user nova-compute[74889]:       <entry name="uuid">78fe06d2-9353-4b9a-8e34-2261f2f77fce</entry>
Nov 10 12:03:05 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:03:05 user nova-compute[74889]:     </system>
Nov 10 12:03:05 user nova-compute[74889]:   </sysinfo>
Nov 10 12:03:05 user nova-compute[74889]:   <os>
Nov 10 12:03:05 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:03:05 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:03:05 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:03:05 user nova-compute[74889]:   </os>
Nov 10 12:03:05 user nova-compute[74889]:   <features>
Nov 10 12:03:05 user nova-compute[74889]:     <acpi/>
Nov 10 12:03:05 user nova-compute[74889]:     <apic/>
Nov 10 12:03:05 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:03:05 user nova-compute[74889]:   </features>
Nov 10 12:03:05 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:03:05 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:03:05 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:03:05 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:03:05 user nova-compute[74889]:   </clock>
Nov 10 12:03:05 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:03:05 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:03:05 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:03:05 user nova-compute[74889]:   </cpu>
Nov 10 12:03:05 user nova-compute[74889]:   <devices>
Nov 10 12:03:05 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:03:05 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:03:05 user nova-compute[74889]:       <source dev="/dev/sdd"/>
Nov 10 12:03:05 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:03:05 user nova-compute[74889]:       <serial>e9f23384-8a98-40fd-af08-babb064b0c5a</serial>
Nov 10 12:03:05 user nova-compute[74889]:     </disk>
Nov 10 12:03:05 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:03:05 user nova-compute[74889]:       <mac address="fa:16:3e:12:a0:f5"/>
Nov 10 12:03:05 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:03:05 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:03:05 user nova-compute[74889]:       <target dev="tapcf06308d-3f"/>
Nov 10 12:03:05 user nova-compute[74889]:     </interface>
Nov 10 12:03:05 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:03:05 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/78fe06d2-9353-4b9a-8e34-2261f2f77fce/console.log" append="off"/>
Nov 10 12:03:05 user nova-compute[74889]:     </serial>
Nov 10 12:03:05 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:03:05 user nova-compute[74889]:     <video>
Nov 10 12:03:05 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:03:05 user nova-compute[74889]:     </video>
Nov 10 12:03:05 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:03:05 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:03:05 user nova-compute[74889]:     </rng>
Nov 10 12:03:05 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:03:05 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:03:05 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:03:05 user nova-compute[74889]:     </memballoon>
Nov 10 12:03:05 user nova-compute[74889]:   </devices>
Nov 10 12:03:05 user nova-compute[74889]: </domain>
Nov 10 12:03:05 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T11:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1185042267',display_name='tempest-TestShelveInstance-server-1185042267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1185042267',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-551479707',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:59:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='63ecf83da57e42c893ec51707cc19d00',ramdisk_id='',reservation_id='r-5a4kdpl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1459906128',owner_user_name='tempest-TestShelveInstance-1459906128-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:02:33Z,user_data=None,user_id='02ca978ddde34a69944046e0ca2ad504',uuid=78fe06d2-9353-4b9a-8e34-2261f2f77fce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converting VIF {"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG os_vif [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c27994cf-fb8b-53a5-bcd9-cd5d88e99765', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf06308d-3f, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf06308d-3f, col_values=(('qos', UUID('e885d587-f74f-4a95-baef-b59511afb1dc')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf06308d-3f, col_values=(('external_ids', {'iface-id': 'cf06308d-3f2e-40e2-b778-561b0c14eea0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:a0:f5', 'vm-uuid': '78fe06d2-9353-4b9a-8e34-2261f2f77fce'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:05 user nova-compute[74889]: INFO os_vif [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f')
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:03:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] No VIF found with MAC fa:16:3e:12:a0:f5, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:03:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-945c9385-03e8-410f-9812-f6f55083c26c req-01ea7a54-3a5f-47a6-a150-5882d3c0df08 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:03:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-945c9385-03e8-410f-9812-f6f55083c26c req-01ea7a54-3a5f-47a6-a150-5882d3c0df08 service nova] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-945c9385-03e8-410f-9812-f6f55083c26c req-01ea7a54-3a5f-47a6-a150-5882d3c0df08 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-945c9385-03e8-410f-9812-f6f55083c26c req-01ea7a54-3a5f-47a6-a150-5882d3c0df08 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-945c9385-03e8-410f-9812-f6f55083c26c req-01ea7a54-3a5f-47a6-a150-5882d3c0df08 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] No waiting events found dispatching network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:03:08 user nova-compute[74889]: WARNING nova.compute.manager [req-945c9385-03e8-410f-9812-f6f55083c26c req-01ea7a54-3a5f-47a6-a150-5882d3c0df08 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received unexpected event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 12:03:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-7cf6be26-e91b-4f51-88a2-43d2a8e8d11a req-c97a5051-4f01-4525-a936-1b45a8269ee4 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:03:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7cf6be26-e91b-4f51-88a2-43d2a8e8d11a req-c97a5051-4f01-4525-a936-1b45a8269ee4 service nova] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7cf6be26-e91b-4f51-88a2-43d2a8e8d11a req-c97a5051-4f01-4525-a936-1b45a8269ee4 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7cf6be26-e91b-4f51-88a2-43d2a8e8d11a req-c97a5051-4f01-4525-a936-1b45a8269ee4 service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-7cf6be26-e91b-4f51-88a2-43d2a8e8d11a req-c97a5051-4f01-4525-a936-1b45a8269ee4 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] No waiting events found dispatching network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:03:10 user nova-compute[74889]: WARNING nova.compute.manager [req-7cf6be26-e91b-4f51-88a2-43d2a8e8d11a req-c97a5051-4f01-4525-a936-1b45a8269ee4 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received unexpected event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 12:03:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:03:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:03:13 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Instance spawned successfully.
Nov 10 12:03:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:03:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ad8c6e9d-6b15-4085-8174-7968b2dc5715 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 40.816s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:03:18 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Creating image(s)
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Ensure instance console log exists: /opt/stack/data/nova/instances/1aaa9255-2adb-4f1e-8952-af99a86fa99d/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Start _get_guest_xml network_info=[{"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHmMjaOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1aaa9255-2adb-4f1e-8952-af99a86fa99d', 'attached_at': '', 'detached_at': '', 'volume_id': '13562062-f66e-40d1-8de7-ef2d8d90ff7b', 'serial': '13562062-f66e-40d1-8de7-ef2d8d90ff7b'}, 'disk_bus': 'virtio', 'attachment_id': '2c83bc25-4316-4353-92d9-2199229634cf', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:03:18 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:03:18 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHmMjaOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:03:18 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:03:18 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:03:18 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[82561d5d-d5a0-4b07-b4ea-3a39dc9ec698]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:03:18 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a85f94-ff5f-4f32-aa08-0fb2c6b11301]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b] added
Nov 10 12:03:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe8fd58-2a4f-40ca-b590-efe06ac4eebc]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf290dfc-f582-45a4-8b81-b9fe85e9286a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHmMjaOU {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHmMjaOU" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e225d-08df-4480-8e58-16a537d4e2d6]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHmMjaOU'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75f862d-e191-45b4-82c4-c1d36656a68f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf99f0a-0c6c-444a-b7d4-ea063ddc3a4b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:03:18 user nova-compute[74889]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:03:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:03:18 user nova-compute[74889]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:03:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed687ba8-5dc9-4103-b0f5-5f66196cfb29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260]
Nov 10 12:03:18 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260] successful.
Nov 10 12:03:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d541ac-afb0-4c32-8365-e17bc8ca7c39]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[26af7aad-488b-4dbc-a89c-a0a96acbca1f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:03:19 user nova-compute[74889]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:03:19 user nova-compute[74889]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:03:19 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:03:19 user nova-compute[74889]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:03:19 user nova-compute[74889]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:03:19 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[58048f59-747f-4b25-8673-11caf6fa1450]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:03:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHmMjaOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26431333136633932', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431333136633932', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1298763924',display_name='tempest-ServerActionsTestOtherA-server-1298763924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1298763924',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV2sPROd86lDqNq7yn/OdL+EAGi3OrNcdrVAdLzqRGaXMCeQRt25LrQ3Ql1TrND/6Dz6MBX7QNwi3U9n4Q2xTxIhGV3gbETVuDolUvGcK3ZVpcr8zuoJBqyHEchy/q4SQ==',key_name='tempest-keypair-943743287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-golc2jfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=1aaa9255-2adb-4f1e-8952-af99a86fa99d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.objects.instance [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aaa9255-2adb-4f1e-8952-af99a86fa99d {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:03:20 user nova-compute[74889]:   <uuid>1aaa9255-2adb-4f1e-8952-af99a86fa99d</uuid>
Nov 10 12:03:20 user nova-compute[74889]:   <name>instance-00000018</name>
Nov 10 12:03:20 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:03:20 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:03:20 user nova-compute[74889]:   <metadata>
Nov 10 12:03:20 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:03:20 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:03:20 user nova-compute[74889]:       <nova:name>tempest-ServerActionsTestOtherA-server-1298763924</nova:name>
Nov 10 12:03:20 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:03:18</nova:creationTime>
Nov 10 12:03:20 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:03:20 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:03:20 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:03:20 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:03:20 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:03:20 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:03:20 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:03:20 user nova-compute[74889]:       <nova:owner>
Nov 10 12:03:20 user nova-compute[74889]:         <nova:user uuid="8f4638ca003c46dab10aab2e5a2e6fb4">tempest-ServerActionsTestOtherA-631643283-project-member</nova:user>
Nov 10 12:03:20 user nova-compute[74889]:         <nova:project uuid="688cad5e5288440bb533d6e2c2f764c1">tempest-ServerActionsTestOtherA-631643283</nova:project>
Nov 10 12:03:20 user nova-compute[74889]:       </nova:owner>
Nov 10 12:03:20 user nova-compute[74889]:       <nova:ports>
Nov 10 12:03:20 user nova-compute[74889]:         <nova:port uuid="ab97e0c2-49c1-4812-b8c5-ede04531a6f0">
Nov 10 12:03:20 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:03:20 user nova-compute[74889]:         </nova:port>
Nov 10 12:03:20 user nova-compute[74889]:       </nova:ports>
Nov 10 12:03:20 user nova-compute[74889]:     </nova:instance>
Nov 10 12:03:20 user nova-compute[74889]:   </metadata>
Nov 10 12:03:20 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:03:20 user nova-compute[74889]:     <system>
Nov 10 12:03:20 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:03:20 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:03:20 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:03:20 user nova-compute[74889]:       <entry name="serial">1aaa9255-2adb-4f1e-8952-af99a86fa99d</entry>
Nov 10 12:03:20 user nova-compute[74889]:       <entry name="uuid">1aaa9255-2adb-4f1e-8952-af99a86fa99d</entry>
Nov 10 12:03:20 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:03:20 user nova-compute[74889]:     </system>
Nov 10 12:03:20 user nova-compute[74889]:   </sysinfo>
Nov 10 12:03:20 user nova-compute[74889]:   <os>
Nov 10 12:03:20 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:03:20 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:03:20 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:03:20 user nova-compute[74889]:   </os>
Nov 10 12:03:20 user nova-compute[74889]:   <features>
Nov 10 12:03:20 user nova-compute[74889]:     <acpi/>
Nov 10 12:03:20 user nova-compute[74889]:     <apic/>
Nov 10 12:03:20 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:03:20 user nova-compute[74889]:   </features>
Nov 10 12:03:20 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:03:20 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:03:20 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:03:20 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:03:20 user nova-compute[74889]:   </clock>
Nov 10 12:03:20 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:03:20 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:03:20 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:03:20 user nova-compute[74889]:   </cpu>
Nov 10 12:03:20 user nova-compute[74889]:   <devices>
Nov 10 12:03:20 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:03:20 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:03:20 user nova-compute[74889]:       <source dev="/dev/sdc"/>
Nov 10 12:03:20 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:03:20 user nova-compute[74889]:       <serial>13562062-f66e-40d1-8de7-ef2d8d90ff7b</serial>
Nov 10 12:03:20 user nova-compute[74889]:     </disk>
Nov 10 12:03:20 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:03:20 user nova-compute[74889]:       <mac address="fa:16:3e:45:07:09"/>
Nov 10 12:03:20 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:03:20 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:03:20 user nova-compute[74889]:       <target dev="tapab97e0c2-49"/>
Nov 10 12:03:20 user nova-compute[74889]:     </interface>
Nov 10 12:03:20 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:03:20 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/1aaa9255-2adb-4f1e-8952-af99a86fa99d/console.log" append="off"/>
Nov 10 12:03:20 user nova-compute[74889]:     </serial>
Nov 10 12:03:20 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:03:20 user nova-compute[74889]:     <video>
Nov 10 12:03:20 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:03:20 user nova-compute[74889]:     </video>
Nov 10 12:03:20 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:03:20 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:03:20 user nova-compute[74889]:     </rng>
Nov 10 12:03:20 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:03:20 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:03:20 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:03:20 user nova-compute[74889]:     </memballoon>
Nov 10 12:03:20 user nova-compute[74889]:   </devices>
Nov 10 12:03:20 user nova-compute[74889]: </domain>
Nov 10 12:03:20 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1298763924',display_name='tempest-ServerActionsTestOtherA-server-1298763924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1298763924',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV2sPROd86lDqNq7yn/OdL+EAGi3OrNcdrVAdLzqRGaXMCeQRt25LrQ3Ql1TrND/6Dz6MBX7QNwi3U9n4Q2xTxIhGV3gbETVuDolUvGcK3ZVpcr8zuoJBqyHEchy/q4SQ==',key_name='tempest-keypair-943743287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-golc2jfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=1aaa9255-2adb-4f1e-8952-af99a86fa99d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG os_vif [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '770b8a58-d812-52d3-86c2-e296765bdeb0', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab97e0c2-49, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab97e0c2-49, col_values=(('qos', UUID('62a8c7c2-cbd1-4aed-bc81-39074d67675b')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab97e0c2-49, col_values=(('external_ids', {'iface-id': 'ab97e0c2-49c1-4812-b8c5-ede04531a6f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:07:09', 'vm-uuid': '1aaa9255-2adb-4f1e-8952-af99a86fa99d'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:20 user nova-compute[74889]: INFO os_vif [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49')
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:03:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No VIF found with MAC fa:16:3e:45:07:09, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:03:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-b263bb81-4cc0-41b8-b016-303be8aac07d req-b22b32ca-600f-462a-bf80-23e67d48d18b service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:03:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b263bb81-4cc0-41b8-b016-303be8aac07d req-b22b32ca-600f-462a-bf80-23e67d48d18b service nova] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b263bb81-4cc0-41b8-b016-303be8aac07d req-b22b32ca-600f-462a-bf80-23e67d48d18b service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b263bb81-4cc0-41b8-b016-303be8aac07d req-b22b32ca-600f-462a-bf80-23e67d48d18b service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-b263bb81-4cc0-41b8-b016-303be8aac07d req-b22b32ca-600f-462a-bf80-23e67d48d18b service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] No waiting events found dispatching network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:03:21 user nova-compute[74889]: WARNING nova.compute.manager [req-b263bb81-4cc0-41b8-b016-303be8aac07d req-b22b32ca-600f-462a-bf80-23e67d48d18b service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received unexpected event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 for instance with vm_state building and task_state spawning.
Nov 10 12:03:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.compute.manager [req-c17467c8-8b32-4dfe-a4d3-5b68b57f3232 req-7ccf82c2-319e-4c70-ae14-34ca89b9f663 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c17467c8-8b32-4dfe-a4d3-5b68b57f3232 req-7ccf82c2-319e-4c70-ae14-34ca89b9f663 service nova] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c17467c8-8b32-4dfe-a4d3-5b68b57f3232 req-7ccf82c2-319e-4c70-ae14-34ca89b9f663 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c17467c8-8b32-4dfe-a4d3-5b68b57f3232 req-7ccf82c2-319e-4c70-ae14-34ca89b9f663 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.compute.manager [req-c17467c8-8b32-4dfe-a4d3-5b68b57f3232 req-7ccf82c2-319e-4c70-ae14-34ca89b9f663 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] No waiting events found dispatching network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:03:24 user nova-compute[74889]: WARNING nova.compute.manager [req-c17467c8-8b32-4dfe-a4d3-5b68b57f3232 req-7ccf82c2-319e-4c70-ae14-34ca89b9f663 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received unexpected event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 for instance with vm_state building and task_state spawning.
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:03:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Instance spawned successfully.
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:24 user nova-compute[74889]: INFO nova.compute.manager [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 10 12:03:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:03:24 user nova-compute[74889]: INFO nova.compute.manager [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Took 36.74 seconds to build instance.
Nov 10 12:03:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-48a2e58e-d7ed-4f59-b183-81424b38eea1 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.885s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "516ca546-b343-4d97-943d-05b975b57f79" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "516ca546-b343-4d97-943d-05b975b57f79" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:03:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:03:28 user nova-compute[74889]: INFO nova.compute.claims [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Claim successful on node user
Nov 10 12:03:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:03:29 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:03:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG nova.policy [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bca3387bf3f434987d7596fb140bc6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6edea315d6148c89ef7f9030eb614a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:03:29 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Creating image(s)
Nov 10 12:03:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "/opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "/opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "/opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "b834a1a3-de16-47e1-bcdd-be059f4625bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "b834a1a3-de16-47e1-bcdd-be059f4625bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.267s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.224s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk 1073741824" returned: 0 in 0.088s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Successfully created port: 5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:03:30 user nova-compute[74889]: INFO nova.compute.claims [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Claim successful on node user
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.211s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Cannot resize image /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Ensure instance console log exists: /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:03:31 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:03:31 user nova-compute[74889]: INFO nova.virt.block_device [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Booting with volume snapshot db5ad8db-bef0-40c8-aa75-fbcc46c125aa at /dev/vda
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Successfully updated port: 5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquired lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-7a28eb66-bb91-4682-ab92-87043f2dc2ac req-b56c1b9f-5908-4370-995e-e7d3c1abbb7f service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received event network-changed-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-7a28eb66-bb91-4682-ab92-87043f2dc2ac req-b56c1b9f-5908-4370-995e-e7d3c1abbb7f service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Refreshing instance network info cache due to event network-changed-5991ae27-b6df-46f7-bf1d-bf4eea8c4592. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7a28eb66-bb91-4682-ab92-87043f2dc2ac req-b56c1b9f-5908-4370-995e-e7d3c1abbb7f service nova] Acquiring lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.policy [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b53b32c4dd094fb4a4b0618dc619b21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e703b195816426d9054c28fa6cd15cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Updating instance_info_cache with network_info: [{"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Releasing lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Instance network_info: |[{"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7a28eb66-bb91-4682-ab92-87043f2dc2ac req-b56c1b9f-5908-4370-995e-e7d3c1abbb7f service nova] Acquired lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-7a28eb66-bb91-4682-ab92-87043f2dc2ac req-b56c1b9f-5908-4370-995e-e7d3c1abbb7f service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Refreshing network info cache for port 5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Start _get_guest_xml network_info=[{"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:03:31 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:03:31 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1515461920',display_name='tempest-ServerActionsTestOtherB-server-1515461920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1515461920',id=25,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1J+9rlEE005T5NZM7+h8MUvAdmv5ZpZtlZWi2+/cY52o6/JfSB4aTilWcZKF4MOh6cvdDqRGKphWCxUxbuOjoLckzjw1zyWVEkxAPhLjlEL33+5gZLeEkZBu0hbR2KtA==',key_name='tempest-keypair-48632366',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6edea315d6148c89ef7f9030eb614a9',ramdisk_id='',reservation_id='r-fvj20ytt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-552761030',owner_user_name='tempest-ServerActionsTestOtherB-552761030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bca3387bf3f434987d7596fb140bc6b',uuid=516ca546-b343-4d97-943d-05b975b57f79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Converting VIF {"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:22:56,bridge_name='br-int',has_traffic_filtering=True,id=5991ae27-b6df-46f7-bf1d-bf4eea8c4592,network=Network(0b7e53da-155f-4e0d-bec9-08175e12d46e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5991ae27-b6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.objects.instance [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lazy-loading 'pci_devices' on Instance uuid 516ca546-b343-4d97-943d-05b975b57f79 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:03:31 user nova-compute[74889]:   <uuid>516ca546-b343-4d97-943d-05b975b57f79</uuid>
Nov 10 12:03:31 user nova-compute[74889]:   <name>instance-00000019</name>
Nov 10 12:03:31 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:03:31 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:03:31 user nova-compute[74889]:   <metadata>
Nov 10 12:03:31 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:03:31 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:03:31 user nova-compute[74889]:       <nova:name>tempest-ServerActionsTestOtherB-server-1515461920</nova:name>
Nov 10 12:03:31 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:03:31</nova:creationTime>
Nov 10 12:03:31 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:03:31 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:03:31 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:03:31 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:03:31 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:03:31 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:03:31 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:03:31 user nova-compute[74889]:       <nova:owner>
Nov 10 12:03:31 user nova-compute[74889]:         <nova:user uuid="5bca3387bf3f434987d7596fb140bc6b">tempest-ServerActionsTestOtherB-552761030-project-member</nova:user>
Nov 10 12:03:31 user nova-compute[74889]:         <nova:project uuid="e6edea315d6148c89ef7f9030eb614a9">tempest-ServerActionsTestOtherB-552761030</nova:project>
Nov 10 12:03:31 user nova-compute[74889]:       </nova:owner>
Nov 10 12:03:31 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:03:31 user nova-compute[74889]:       <nova:ports>
Nov 10 12:03:31 user nova-compute[74889]:         <nova:port uuid="5991ae27-b6df-46f7-bf1d-bf4eea8c4592">
Nov 10 12:03:31 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 12:03:31 user nova-compute[74889]:         </nova:port>
Nov 10 12:03:31 user nova-compute[74889]:       </nova:ports>
Nov 10 12:03:31 user nova-compute[74889]:     </nova:instance>
Nov 10 12:03:31 user nova-compute[74889]:   </metadata>
Nov 10 12:03:31 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:03:31 user nova-compute[74889]:     <system>
Nov 10 12:03:31 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:03:31 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:03:31 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:03:31 user nova-compute[74889]:       <entry name="serial">516ca546-b343-4d97-943d-05b975b57f79</entry>
Nov 10 12:03:31 user nova-compute[74889]:       <entry name="uuid">516ca546-b343-4d97-943d-05b975b57f79</entry>
Nov 10 12:03:31 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:03:31 user nova-compute[74889]:     </system>
Nov 10 12:03:31 user nova-compute[74889]:   </sysinfo>
Nov 10 12:03:31 user nova-compute[74889]:   <os>
Nov 10 12:03:31 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:03:31 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:03:31 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:03:31 user nova-compute[74889]:   </os>
Nov 10 12:03:31 user nova-compute[74889]:   <features>
Nov 10 12:03:31 user nova-compute[74889]:     <acpi/>
Nov 10 12:03:31 user nova-compute[74889]:     <apic/>
Nov 10 12:03:31 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:03:31 user nova-compute[74889]:   </features>
Nov 10 12:03:31 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:03:31 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:03:31 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:03:31 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:03:31 user nova-compute[74889]:   </clock>
Nov 10 12:03:31 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:03:31 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:03:31 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:03:31 user nova-compute[74889]:   </cpu>
Nov 10 12:03:31 user nova-compute[74889]:   <devices>
Nov 10 12:03:31 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:03:31 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:03:31 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk"/>
Nov 10 12:03:31 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:03:31 user nova-compute[74889]:     </disk>
Nov 10 12:03:31 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:03:31 user nova-compute[74889]:       <mac address="fa:16:3e:fb:22:56"/>
Nov 10 12:03:31 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:03:31 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:03:31 user nova-compute[74889]:       <target dev="tap5991ae27-b6"/>
Nov 10 12:03:31 user nova-compute[74889]:     </interface>
Nov 10 12:03:31 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:03:31 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/console.log" append="off"/>
Nov 10 12:03:31 user nova-compute[74889]:     </serial>
Nov 10 12:03:31 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:03:31 user nova-compute[74889]:     <video>
Nov 10 12:03:31 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:03:31 user nova-compute[74889]:     </video>
Nov 10 12:03:31 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:03:31 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:03:31 user nova-compute[74889]:     </rng>
Nov 10 12:03:31 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:03:31 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:03:31 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:03:31 user nova-compute[74889]:     </memballoon>
Nov 10 12:03:31 user nova-compute[74889]:   </devices>
Nov 10 12:03:31 user nova-compute[74889]: </domain>
Nov 10 12:03:31 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1515461920',display_name='tempest-ServerActionsTestOtherB-server-1515461920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1515461920',id=25,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1J+9rlEE005T5NZM7+h8MUvAdmv5ZpZtlZWi2+/cY52o6/JfSB4aTilWcZKF4MOh6cvdDqRGKphWCxUxbuOjoLckzjw1zyWVEkxAPhLjlEL33+5gZLeEkZBu0hbR2KtA==',key_name='tempest-keypair-48632366',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6edea315d6148c89ef7f9030eb614a9',ramdisk_id='',reservation_id='r-fvj20ytt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-552761030',owner_user_name='tempest-ServerActionsTestOtherB-552761030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bca3387bf3f434987d7596fb140bc6b',uuid=516ca546-b343-4d97-943d-05b975b57f79,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Converting VIF {"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:22:56,bridge_name='br-int',has_traffic_filtering=True,id=5991ae27-b6df-46f7-bf1d-bf4eea8c4592,network=Network(0b7e53da-155f-4e0d-bec9-08175e12d46e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5991ae27-b6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG os_vif [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:22:56,bridge_name='br-int',has_traffic_filtering=True,id=5991ae27-b6df-46f7-bf1d-bf4eea8c4592,network=Network(0b7e53da-155f-4e0d-bec9-08175e12d46e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5991ae27-b6') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64a087f6-6ebf-5b36-92b6-5eab5f24f8d4', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5991ae27-b6, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5991ae27-b6, col_values=(('qos', UUID('858a9df8-8f6c-4d43-8609-c81a7fd31350')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5991ae27-b6, col_values=(('external_ids', {'iface-id': '5991ae27-b6df-46f7-bf1d-bf4eea8c4592', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:22:56', 'vm-uuid': '516ca546-b343-4d97-943d-05b975b57f79'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:31 user nova-compute[74889]: INFO os_vif [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:22:56,bridge_name='br-int',has_traffic_filtering=True,id=5991ae27-b6df-46f7-bf1d-bf4eea8c4592,network=Network(0b7e53da-155f-4e0d-bec9-08175e12d46e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5991ae27-b6')
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:03:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] No VIF found with MAC fa:16:3e:fb:22:56, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:03:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-7a28eb66-bb91-4682-ab92-87043f2dc2ac req-b56c1b9f-5908-4370-995e-e7d3c1abbb7f service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Updated VIF entry in instance network info cache for port 5991ae27-b6df-46f7-bf1d-bf4eea8c4592. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:03:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-7a28eb66-bb91-4682-ab92-87043f2dc2ac req-b56c1b9f-5908-4370-995e-e7d3c1abbb7f service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Updating instance_info_cache with network_info: [{"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:03:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7a28eb66-bb91-4682-ab92-87043f2dc2ac req-b56c1b9f-5908-4370-995e-e7d3c1abbb7f service nova] Releasing lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:03:32 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Successfully created port: f1246f76-151c-4abd-a9a8-2d9470516c5a {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:03:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Successfully updated port: f1246f76-151c-4abd-a9a8-2d9470516c5a {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-1d221636-36b9-4e6f-ae3c-8b2fb9d04ba8 req-7644864e-aebd-4727-ac3e-6409809a841f service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received event network-vif-plugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1d221636-36b9-4e6f-ae3c-8b2fb9d04ba8 req-7644864e-aebd-4727-ac3e-6409809a841f service nova] Acquiring lock "516ca546-b343-4d97-943d-05b975b57f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1d221636-36b9-4e6f-ae3c-8b2fb9d04ba8 req-7644864e-aebd-4727-ac3e-6409809a841f service nova] Lock "516ca546-b343-4d97-943d-05b975b57f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1d221636-36b9-4e6f-ae3c-8b2fb9d04ba8 req-7644864e-aebd-4727-ac3e-6409809a841f service nova] Lock "516ca546-b343-4d97-943d-05b975b57f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-1d221636-36b9-4e6f-ae3c-8b2fb9d04ba8 req-7644864e-aebd-4727-ac3e-6409809a841f service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] No waiting events found dispatching network-vif-plugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:03:33 user nova-compute[74889]: WARNING nova.compute.manager [req-1d221636-36b9-4e6f-ae3c-8b2fb9d04ba8 req-7644864e-aebd-4727-ac3e-6409809a841f service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received unexpected event network-vif-plugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 for instance with vm_state building and task_state spawning.
Nov 10 12:03:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "refresh_cache-b834a1a3-de16-47e1-bcdd-be059f4625bf" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquired lock "refresh_cache-b834a1a3-de16-47e1-bcdd-be059f4625bf" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:03:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:34 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Updating instance_info_cache with network_info: [{"id": "f1246f76-151c-4abd-a9a8-2d9470516c5a", "address": "fa:16:3e:dc:55:0a", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1246f76-15", "ovs_interfaceid": "f1246f76-151c-4abd-a9a8-2d9470516c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:03:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Releasing lock "refresh_cache-b834a1a3-de16-47e1-bcdd-be059f4625bf" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:03:34 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Instance network_info: |[{"id": "f1246f76-151c-4abd-a9a8-2d9470516c5a", "address": "fa:16:3e:dc:55:0a", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1246f76-15", "ovs_interfaceid": "f1246f76-151c-4abd-a9a8-2d9470516c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:03:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Received event network-changed-f1246f76-151c-4abd-a9a8-2d9470516c5a {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:03:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Refreshing instance network info cache due to event network-changed-f1246f76-151c-4abd-a9a8-2d9470516c5a. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:03:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] Acquiring lock "refresh_cache-b834a1a3-de16-47e1-bcdd-be059f4625bf" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:03:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] Acquired lock "refresh_cache-b834a1a3-de16-47e1-bcdd-be059f4625bf" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:03:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Refreshing network info cache for port f1246f76-151c-4abd-a9a8-2d9470516c5a {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:03:36 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Instance spawned successfully.
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:36 user nova-compute[74889]: INFO nova.compute.manager [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:03:36 user nova-compute[74889]: INFO nova.compute.manager [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Took 7.43 seconds to build instance.
Nov 10 12:03:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d218c3c3-e3ea-4a9b-9b9f-34771dd16231 tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "516ca546-b343-4d97-943d-05b975b57f79" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.594s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.network.neutron [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Updated VIF entry in instance network info cache for port f1246f76-151c-4abd-a9a8-2d9470516c5a. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.network.neutron [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Updating instance_info_cache with network_info: [{"id": "f1246f76-151c-4abd-a9a8-2d9470516c5a", "address": "fa:16:3e:dc:55:0a", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1246f76-15", "ovs_interfaceid": "f1246f76-151c-4abd-a9a8-2d9470516c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] Releasing lock "refresh_cache-b834a1a3-de16-47e1-bcdd-be059f4625bf" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received event network-vif-plugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] Acquiring lock "516ca546-b343-4d97-943d-05b975b57f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] Lock "516ca546-b343-4d97-943d-05b975b57f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] Lock "516ca546-b343-4d97-943d-05b975b57f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] No waiting events found dispatching network-vif-plugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:03:36 user nova-compute[74889]: WARNING nova.compute.manager [req-fdbbe022-bca4-400a-be5c-24efa9da20ec req-e190d3cd-0b53-45c1-b15f-48e946fbd035 service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received unexpected event network-vif-plugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 for instance with vm_state building and task_state spawning.
Nov 10 12:03:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:37 user nova-compute[74889]: INFO nova.compute.manager [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Detaching volume bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d
Nov 10 12:03:37 user nova-compute[74889]: INFO nova.virt.block_device [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Attempting to driver detach volume bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d from mountpoint /dev/vdb
Nov 10 12:03:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Attempting to detach device vdb from instance 93367290-6fa4-4bbe-b47b-2dfa27227bed from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:03:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:03:37 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:03:37 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 12:03:37 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:03:37 user nova-compute[74889]:   <serial>bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d</serial>
Nov 10 12:03:37 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:03:37 user nova-compute[74889]: </disk>
Nov 10 12:03:37 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:03:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully detached device vdb from instance 93367290-6fa4-4bbe-b47b-2dfa27227bed from the persistent domain config.
Nov 10 12:03:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93367290-6fa4-4bbe-b47b-2dfa27227bed from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:03:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:03:37 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:03:37 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 12:03:37 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:03:37 user nova-compute[74889]:   <serial>bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d</serial>
Nov 10 12:03:37 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:03:37 user nova-compute[74889]: </disk>
Nov 10 12:03:37 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:03:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93367290-6fa4-4bbe-b47b-2dfa27227bed {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:03:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:40 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:03:40 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG os_brick.utils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[006fd1c3-4afc-4b92-9d76-8075ec823d4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f8888e-c1cd-4501-a040-8dd51240775b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d8aedc-2cdb-4060-8496-5d56df873080]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb17a6dc-b6c3-4bfc-8836-4d99a937871a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:03:42 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52ba67f-3960-477b-a00c-4f5b8a882f7b]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG os_brick.utils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Updating existing volume attachment record: 0ade9de5-fbb4-4daf-b6a4-164adbae6293 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:03:42 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:03:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7902MB free_disk=25.506610870361328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 93367290-6fa4-4bbe-b47b-2dfa27227bed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 22718082-4c44-4384-8692-c216bb1a14e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance b11fa594-7afe-4454-bbc2-e68a3564500e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 78fe06d2-9353-4b9a-8e34-2261f2f77fce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 1aaa9255-2adb-4f1e-8952-af99a86fa99d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 516ca546-b343-4d97-943d-05b975b57f79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance b834a1a3-de16-47e1-bcdd-be059f4625bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:03:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:49 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:03:49 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:03:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:03:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:03:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:03:49 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:03:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:03:50 user nova-compute[74889]: INFO nova.compute.claims [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Claim successful on node user
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Updating instance_info_cache with network_info: [{"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-93367290-6fa4-4bbe-b47b-2dfa27227bed" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.network.neutron [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:03:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.policy [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f59a12b24b02408e9602dd7146453a57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1298008035034b9ea352dc01af38a417', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:03:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Creating image(s)
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "/opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "/opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "/opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "540210a18e215cf21650e413ca360bd1703e05e2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "540210a18e215cf21650e413ca360bd1703e05e2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:51 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2.part --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:03:51 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:03:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:51 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2.part --force-share --output=json" returned: 0 in 0.234s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:51 user nova-compute[74889]: DEBUG nova.virt.images [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] fbe829ed-182b-46da-8c51-62f2090890e1 was qcow2, converting to raw {{(pid=74889) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 12:03:51 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:03:51 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2.part /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2.converted {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2.part /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2.converted" returned: 0 in 0.328s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2.converted --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG nova.network.neutron [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Successfully created port: 4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "540210a18e215cf21650e413ca360bd1703e05e2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.677s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2 --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "540210a18e215cf21650e413ca360bd1703e05e2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "540210a18e215cf21650e413ca360bd1703e05e2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2 --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2,backing_fmt=raw /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2,backing_fmt=raw /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk 1073741824" returned: 0 in 0.054s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "540210a18e215cf21650e413ca360bd1703e05e2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2 --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Cannot resize image /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Ensure instance console log exists: /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Successfully updated port: 4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquired lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.compute.manager [req-90e5c970-9024-4af4-aa6b-8196e429bbfb req-845bfa43-c198-499e-8418-0270acad951c service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-changed-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.compute.manager [req-90e5c970-9024-4af4-aa6b-8196e429bbfb req-845bfa43-c198-499e-8418-0270acad951c service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Refreshing instance network info cache due to event network-changed-4a76e957-2ed4-480f-8493-aef332d05f7c. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-90e5c970-9024-4af4-aa6b-8196e429bbfb req-845bfa43-c198-499e-8418-0270acad951c service nova] Acquiring lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updating instance_info_cache with network_info: [{"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Releasing lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Instance network_info: |[{"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-90e5c970-9024-4af4-aa6b-8196e429bbfb req-845bfa43-c198-499e-8418-0270acad951c service nova] Acquired lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.network.neutron [req-90e5c970-9024-4af4-aa6b-8196e429bbfb req-845bfa43-c198-499e-8418-0270acad951c service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Refreshing network info cache for port 4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:03:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Start _get_guest_xml network_info=[{"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T12:03:47Z,direct_url=<?>,disk_format='qcow2',id=fbe829ed-182b-46da-8c51-62f2090890e1,min_disk=0,min_ram=0,name='tempest-scenario-img--1812678196',owner='1298008035034b9ea352dc01af38a417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T12:03:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'fbe829ed-182b-46da-8c51-62f2090890e1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:03:54 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:03:54 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T12:03:47Z,direct_url=<?>,disk_format='qcow2',id=fbe829ed-182b-46da-8c51-62f2090890e1,min_disk=0,min_ram=0,name='tempest-scenario-img--1812678196',owner='1298008035034b9ea352dc01af38a417',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T12:03:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-671676259',display_name='tempest-TestMinimumBasicScenario-server-671676259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-671676259',id=27,image_ref='fbe829ed-182b-46da-8c51-62f2090890e1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdgK6uepGNExQDq6f+TujVQ9Wy4LBwykOQIGkieJd8zFMATtV+3UvLtjXvRYhmBN89lG6KH9/ROR0FMy9Zn/wUgfMnZl6xxmAG90NICPNL7Q6otsoLTho0zY6m45O6nMQ==',key_name='tempest-TestMinimumBasicScenario-601543450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1298008035034b9ea352dc01af38a417',ramdisk_id='',reservation_id='r-w1x3g4j8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fbe829ed-182b-46da-8c51-62f2090890e1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1750479142',owner_user_name='tempest-TestMinimumBasicScenario-1750479142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:03:51Z,user_data=None,user_id='f59a12b24b02408e9602dd7146453a57',uuid=a37438e5-4f27-439c-a9f9-c3f9aa396d94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converting VIF {"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:84:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a76e957-2ed4-480f-8493-aef332d05f7c,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a76e957-2e') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.objects.instance [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'pci_devices' on Instance uuid a37438e5-4f27-439c-a9f9-c3f9aa396d94 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:03:54 user nova-compute[74889]:   <uuid>a37438e5-4f27-439c-a9f9-c3f9aa396d94</uuid>
Nov 10 12:03:54 user nova-compute[74889]:   <name>instance-0000001b</name>
Nov 10 12:03:54 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:03:54 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:03:54 user nova-compute[74889]:   <metadata>
Nov 10 12:03:54 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:03:54 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:03:54 user nova-compute[74889]:       <nova:name>tempest-TestMinimumBasicScenario-server-671676259</nova:name>
Nov 10 12:03:54 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:03:54</nova:creationTime>
Nov 10 12:03:54 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:03:54 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:03:54 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:03:54 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:03:54 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:03:54 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:03:54 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:03:54 user nova-compute[74889]:       <nova:owner>
Nov 10 12:03:54 user nova-compute[74889]:         <nova:user uuid="f59a12b24b02408e9602dd7146453a57">tempest-TestMinimumBasicScenario-1750479142-project-member</nova:user>
Nov 10 12:03:54 user nova-compute[74889]:         <nova:project uuid="1298008035034b9ea352dc01af38a417">tempest-TestMinimumBasicScenario-1750479142</nova:project>
Nov 10 12:03:54 user nova-compute[74889]:       </nova:owner>
Nov 10 12:03:54 user nova-compute[74889]:       <nova:root type="image" uuid="fbe829ed-182b-46da-8c51-62f2090890e1"/>
Nov 10 12:03:54 user nova-compute[74889]:       <nova:ports>
Nov 10 12:03:54 user nova-compute[74889]:         <nova:port uuid="4a76e957-2ed4-480f-8493-aef332d05f7c">
Nov 10 12:03:54 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 12:03:54 user nova-compute[74889]:         </nova:port>
Nov 10 12:03:54 user nova-compute[74889]:       </nova:ports>
Nov 10 12:03:54 user nova-compute[74889]:     </nova:instance>
Nov 10 12:03:54 user nova-compute[74889]:   </metadata>
Nov 10 12:03:54 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:03:54 user nova-compute[74889]:     <system>
Nov 10 12:03:54 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:03:54 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:03:54 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:03:54 user nova-compute[74889]:       <entry name="serial">a37438e5-4f27-439c-a9f9-c3f9aa396d94</entry>
Nov 10 12:03:54 user nova-compute[74889]:       <entry name="uuid">a37438e5-4f27-439c-a9f9-c3f9aa396d94</entry>
Nov 10 12:03:54 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:03:54 user nova-compute[74889]:     </system>
Nov 10 12:03:54 user nova-compute[74889]:   </sysinfo>
Nov 10 12:03:54 user nova-compute[74889]:   <os>
Nov 10 12:03:54 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:03:54 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:03:54 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:03:54 user nova-compute[74889]:   </os>
Nov 10 12:03:54 user nova-compute[74889]:   <features>
Nov 10 12:03:54 user nova-compute[74889]:     <acpi/>
Nov 10 12:03:54 user nova-compute[74889]:     <apic/>
Nov 10 12:03:54 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:03:54 user nova-compute[74889]:   </features>
Nov 10 12:03:54 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:03:54 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:03:54 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:03:54 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:03:54 user nova-compute[74889]:   </clock>
Nov 10 12:03:54 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:03:54 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:03:54 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:03:54 user nova-compute[74889]:   </cpu>
Nov 10 12:03:54 user nova-compute[74889]:   <devices>
Nov 10 12:03:54 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:03:54 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:03:54 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk"/>
Nov 10 12:03:54 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:03:54 user nova-compute[74889]:     </disk>
Nov 10 12:03:54 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:03:54 user nova-compute[74889]:       <mac address="fa:16:3e:1f:84:ff"/>
Nov 10 12:03:54 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:03:54 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:03:54 user nova-compute[74889]:       <target dev="tap4a76e957-2e"/>
Nov 10 12:03:54 user nova-compute[74889]:     </interface>
Nov 10 12:03:54 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:03:54 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/console.log" append="off"/>
Nov 10 12:03:54 user nova-compute[74889]:     </serial>
Nov 10 12:03:54 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:03:54 user nova-compute[74889]:     <video>
Nov 10 12:03:54 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:03:54 user nova-compute[74889]:     </video>
Nov 10 12:03:54 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:03:54 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:03:54 user nova-compute[74889]:     </rng>
Nov 10 12:03:54 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:03:54 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:03:54 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:03:54 user nova-compute[74889]:     </memballoon>
Nov 10 12:03:54 user nova-compute[74889]:   </devices>
Nov 10 12:03:54 user nova-compute[74889]: </domain>
Nov 10 12:03:54 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-671676259',display_name='tempest-TestMinimumBasicScenario-server-671676259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-671676259',id=27,image_ref='fbe829ed-182b-46da-8c51-62f2090890e1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdgK6uepGNExQDq6f+TujVQ9Wy4LBwykOQIGkieJd8zFMATtV+3UvLtjXvRYhmBN89lG6KH9/ROR0FMy9Zn/wUgfMnZl6xxmAG90NICPNL7Q6otsoLTho0zY6m45O6nMQ==',key_name='tempest-TestMinimumBasicScenario-601543450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1298008035034b9ea352dc01af38a417',ramdisk_id='',reservation_id='r-w1x3g4j8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fbe829ed-182b-46da-8c51-62f2090890e1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1750479142',owner_user_name='tempest-TestMinimumBasicScenario-1750479142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:03:51Z,user_data=None,user_id='f59a12b24b02408e9602dd7146453a57',uuid=a37438e5-4f27-439c-a9f9-c3f9aa396d94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converting VIF {"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:84:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a76e957-2ed4-480f-8493-aef332d05f7c,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a76e957-2e') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG os_vif [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:84:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a76e957-2ed4-480f-8493-aef332d05f7c,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a76e957-2e') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3704f5f1-693c-5a61-8e3f-b2b625d3800d', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a76e957-2e, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a76e957-2e, col_values=(('qos', UUID('981debf1-b8e7-418b-bd5d-d3266e4f5e5d')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a76e957-2e, col_values=(('external_ids', {'iface-id': '4a76e957-2ed4-480f-8493-aef332d05f7c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:84:ff', 'vm-uuid': 'a37438e5-4f27-439c-a9f9-c3f9aa396d94'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:54 user nova-compute[74889]: INFO os_vif [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:84:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a76e957-2ed4-480f-8493-aef332d05f7c,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a76e957-2e')
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] No VIF found with MAC fa:16:3e:1f:84:ff, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.network.neutron [req-90e5c970-9024-4af4-aa6b-8196e429bbfb req-845bfa43-c198-499e-8418-0270acad951c service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updated VIF entry in instance network info cache for port 4a76e957-2ed4-480f-8493-aef332d05f7c. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG nova.network.neutron [req-90e5c970-9024-4af4-aa6b-8196e429bbfb req-845bfa43-c198-499e-8418-0270acad951c service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updating instance_info_cache with network_info: [{"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-90e5c970-9024-4af4-aa6b-8196e429bbfb req-845bfa43-c198-499e-8418-0270acad951c service nova] Releasing lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:03:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:57 user nova-compute[74889]: DEBUG nova.compute.manager [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:03:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:03:57 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Instance spawned successfully.
Nov 10 12:03:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:03:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:03:57 user nova-compute[74889]: INFO nova.compute.manager [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Took 7.17 seconds to spawn the instance on the hypervisor.
Nov 10 12:03:57 user nova-compute[74889]: DEBUG nova.compute.manager [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:03:57 user nova-compute[74889]: INFO nova.compute.manager [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Took 8.00 seconds to build instance.
Nov 10 12:03:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-abe74d38-5eca-4e59-843c-f1bb0a79f33a tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.130s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:03:58 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 93367290-6fa4-4bbe-b47b-2dfa27227bed is timed out.
Nov 10 12:03:58 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully detached device vdb from instance 93367290-6fa4-4bbe-b47b-2dfa27227bed from the live domain config.
Nov 10 12:03:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'umkqRVGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:03:58 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d17a506-55df-4216-82cb-44b81561d18d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:03:58 user nova-compute[74889]: No targets found.
Nov 10 12:03:58 user nova-compute[74889]: iSNS:
Nov 10 12:03:58 user nova-compute[74889]: No targets found.
Nov 10 12:03:58 user nova-compute[74889]: STATIC:
Nov 10 12:03:58 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a
Nov 10 12:03:58 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:03:58 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:03:58 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:03:58 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:03:58 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:03:58 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d
Nov 10 12:03:58 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:03:58 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:03:58 user nova-compute[74889]: FIRMWARE:
Nov 10 12:03:58 user nova-compute[74889]: No targets found.
Nov 10 12:03:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:03:58 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:03:58 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34aae8b-8e38-4985-8538-1f5e7dc89a4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d332c99-a33a-406a-8de5-07d88c2f395e]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:03:58 user nova-compute[74889]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:03:58 user nova-compute[74889]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:03:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d (non-flash)
Nov 10 12:03:58 user nova-compute[74889]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:03:58 user nova-compute[74889]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:03:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398395990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3f95ec-5a2d-4038-bd16-cf83965234bb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[170f3812-0d9a-4a38-8eb3-55851a20bd02]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ce5241-1184-4f38-8f49-bb596165bfa5]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edb11c1-306b-4602-bbfa-3b3cec0da93a]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa382cb-54f9-430b-ae93-1b36c40cbdb7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[960ac861-0f08-48c6-8b8a-d7d379f19af0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d, portal: 172.16.0.220,3260]
Nov 10 12:03:58 user nova-compute[74889]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d, portal: 172.16.0.220,3260] successful.
Nov 10 12:03:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd3f5d4f-ecee-4f34-b0a3-54c53cb20f5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e0267-20a3-4c87-a94a-d87210a7588d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] <== disconnect_volume: return (389ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:03:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:03:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:03:59 user nova-compute[74889]: DEBUG nova.objects.instance [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'flavor' on Instance uuid 93367290-6fa4-4bbe-b47b-2dfa27227bed {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:03:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b42cb1b9-997b-4d42-9276-1890ec4f36fc tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.168s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-683ff06f-0cd0-442d-9e2b-81e0e641b0d2 req-4990d7c7-66b5-47ea-811b-cda9e58330ae service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-683ff06f-0cd0-442d-9e2b-81e0e641b0d2 req-4990d7c7-66b5-47ea-811b-cda9e58330ae service nova] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-683ff06f-0cd0-442d-9e2b-81e0e641b0d2 req-4990d7c7-66b5-47ea-811b-cda9e58330ae service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-683ff06f-0cd0-442d-9e2b-81e0e641b0d2 req-4990d7c7-66b5-47ea-811b-cda9e58330ae service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-683ff06f-0cd0-442d-9e2b-81e0e641b0d2 req-4990d7c7-66b5-47ea-811b-cda9e58330ae service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] No waiting events found dispatching network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:04:00 user nova-compute[74889]: WARNING nova.compute.manager [req-683ff06f-0cd0-442d-9e2b-81e0e641b0d2 req-4990d7c7-66b5-47ea-811b-cda9e58330ae service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received unexpected event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c for instance with vm_state active and task_state None.
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.volume.cinder [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Update attachment failed for attachment 0ade9de5-fbb4-4daf-b6a4-164adbae6293. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb50c726-a1c8-485f-a29a-03dac69e9273) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb50c726-a1c8-485f-a29a-03dac69e9273)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb50c726-a1c8-485f-a29a-03dac69e9273)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Traceback (most recent call last):
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     driver_block_device.attach_block_devices(
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     _log_and_attach(device)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/virt/block_device.py", line 819, in attach
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     super(DriverVolSnapshotBlockDevice, self).attach(
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     self._do_attach(context, instance, volume, volume_api,
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     self._volume_attach(context, volume, connector, instance,
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     connection_info = volume_api.attachment_update(
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     res = method(self, ctx, *args, **kwargs)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     with excutils.save_and_reraise_exception():
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     self.force_reraise()
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     raise self.value
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     return method.func(obj, *args, **kwargs)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     resp = self._update('/attachments/%s' % id, body)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     return self.request(url, method, **kwargs)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf]     raise exceptions.from_response(resp, body)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb50c726-a1c8-485f-a29a-03dac69e9273)
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] 
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.compute.claims [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Aborting claim: <nova.compute.claims.Claim object at 0x7fa388327640> {{(pid=74889) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.440s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Build of instance b834a1a3-de16-47e1-bcdd-be059f4625bf aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb50c726-a1c8-485f-a29a-03dac69e9273) {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.compute.utils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Build of instance b834a1a3-de16-47e1-bcdd-be059f4625bf aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74889) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 12:04:00 user nova-compute[74889]: ERROR nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Build of instance b834a1a3-de16-47e1-bcdd-be059f4625bf aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb50c726-a1c8-485f-a29a-03dac69e9273): nova.exception.BuildAbortException: Build of instance b834a1a3-de16-47e1-bcdd-be059f4625bf aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb50c726-a1c8-485f-a29a-03dac69e9273)
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Unplugging VIFs for instance {{(pid=74889) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-532524114',display_name='tempest-TestVolumeBootPattern-server-532524114',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-532524114',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-0qpo0lqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:03:31Z,user_data=None,user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=b834a1a3-de16-47e1-bcdd-be059f4625bf,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1246f76-151c-4abd-a9a8-2d9470516c5a", "address": "fa:16:3e:dc:55:0a", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1246f76-15", "ovs_interfaceid": "f1246f76-151c-4abd-a9a8-2d9470516c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "f1246f76-151c-4abd-a9a8-2d9470516c5a", "address": "fa:16:3e:dc:55:0a", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1246f76-15", "ovs_interfaceid": "f1246f76-151c-4abd-a9a8-2d9470516c5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:55:0a,bridge_name='br-int',has_traffic_filtering=True,id=f1246f76-151c-4abd-a9a8-2d9470516c5a,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1246f76-15') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG os_vif [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:55:0a,bridge_name='br-int',has_traffic_filtering=True,id=f1246f76-151c-4abd-a9a8-2d9470516c5a,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1246f76-15') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1246f76-15, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:04:00 user nova-compute[74889]: INFO os_vif [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:55:0a,bridge_name='br-int',has_traffic_filtering=True,id=f1246f76-151c-4abd-a9a8-2d9470516c5a,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1246f76-15')
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Unplugged VIFs for instance {{(pid=74889) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:04:00 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:04:01 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:01 user nova-compute[74889]: INFO nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Took 0.59 seconds to deallocate network for instance.
Nov 10 12:04:01 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Detaching volume: 63f6a7b9-67b6-4244-85ec-0be888d8e3f8 {{(pid=74889) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 12:04:01 user nova-compute[74889]: INFO nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Detaching volume 63f6a7b9-67b6-4244-85ec-0be888d8e3f8
Nov 10 12:04:01 user nova-compute[74889]: ERROR nova.virt.block_device [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Unable to call for a driver detach of volume 63f6a7b9-67b6-4244-85ec-0be888d8e3f8 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance b834a1a3-de16-47e1-bcdd-be059f4625bf aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-cb50c726-a1c8-485f-a29a-03dac69e9273)
Nov 10 12:04:01 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: b834a1a3-de16-47e1-bcdd-be059f4625bf] Deleting volume: 63f6a7b9-67b6-4244-85ec-0be888d8e3f8 {{(pid=74889) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 12:04:01 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Deleted allocations for instance b834a1a3-de16-47e1-bcdd-be059f4625bf
Nov 10 12:04:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80a314e4-4894-479c-a3d0-308fdcf4293e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "b834a1a3-de16-47e1-bcdd-be059f4625bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.831s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-b6953d29-ed06-40e1-8564-8fcad67528e4 req-6ea9a8dd-bb33-474f-95d4-e2c0a9f63631 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b6953d29-ed06-40e1-8564-8fcad67528e4 req-6ea9a8dd-bb33-474f-95d4-e2c0a9f63631 service nova] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b6953d29-ed06-40e1-8564-8fcad67528e4 req-6ea9a8dd-bb33-474f-95d4-e2c0a9f63631 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b6953d29-ed06-40e1-8564-8fcad67528e4 req-6ea9a8dd-bb33-474f-95d4-e2c0a9f63631 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-b6953d29-ed06-40e1-8564-8fcad67528e4 req-6ea9a8dd-bb33-474f-95d4-e2c0a9f63631 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] No waiting events found dispatching network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:04:02 user nova-compute[74889]: WARNING nova.compute.manager [req-b6953d29-ed06-40e1-8564-8fcad67528e4 req-6ea9a8dd-bb33-474f-95d4-e2c0a9f63631 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received unexpected event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c for instance with vm_state active and task_state None.
Nov 10 12:04:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-021fa226-0f87-4d4e-8cf8-a9b9eeda78d4 req-4f0f25d3-a962-457c-af3a-4aa1e96e3ea0 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-changed-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-021fa226-0f87-4d4e-8cf8-a9b9eeda78d4 req-4f0f25d3-a962-457c-af3a-4aa1e96e3ea0 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Refreshing instance network info cache due to event network-changed-4ceb9d41-aad6-4ed3-8b12-50413fabe32d. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-021fa226-0f87-4d4e-8cf8-a9b9eeda78d4 req-4f0f25d3-a962-457c-af3a-4aa1e96e3ea0 service nova] Acquiring lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-021fa226-0f87-4d4e-8cf8-a9b9eeda78d4 req-4f0f25d3-a962-457c-af3a-4aa1e96e3ea0 service nova] Acquired lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-021fa226-0f87-4d4e-8cf8-a9b9eeda78d4 req-4f0f25d3-a962-457c-af3a-4aa1e96e3ea0 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Refreshing network info cache for port 4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-021fa226-0f87-4d4e-8cf8-a9b9eeda78d4 req-4f0f25d3-a962-457c-af3a-4aa1e96e3ea0 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updated VIF entry in instance network info cache for port 4ceb9d41-aad6-4ed3-8b12-50413fabe32d. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:04:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-021fa226-0f87-4d4e-8cf8-a9b9eeda78d4 req-4f0f25d3-a962-457c-af3a-4aa1e96e3ea0 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updating instance_info_cache with network_info: [{"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-021fa226-0f87-4d4e-8cf8-a9b9eeda78d4 req-4f0f25d3-a962-457c-af3a-4aa1e96e3ea0 service nova] Releasing lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG nova.objects.instance [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid b11fa594-7afe-4454-bbc2-e68a3564500e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:21 user nova-compute[74889]: INFO nova.compute.manager [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Attaching volume a16e1e1e-0f83-4abe-bf3c-c849dd76a529 to /dev/vdb
Nov 10 12:04:21 user nova-compute[74889]: DEBUG os_brick.utils [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e989de00-87ff-471f-9ff3-ea22ebedef4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7ee562-2edb-4027-9044-5f524fcd55d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7139a3-037b-410b-b0fb-987cd632fe79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6316983a-1ae1-46f9-8a46-523963b5936e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:04:21 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:04:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b875e6e-987b-428f-854e-7415c4490108]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG os_brick.utils [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:04:21 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updating existing volume attachment record: a6266091-80d7-4052-8791-6708a564ca95 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG nova.compute.manager [req-e44e5194-2a81-49e8-8d84-f2264f2fb1ed req-87e10ebe-c5e5-4615-b00b-a2a57687deb2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-changed-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG nova.compute.manager [req-e44e5194-2a81-49e8-8d84-f2264f2fb1ed req-87e10ebe-c5e5-4615-b00b-a2a57687deb2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Refreshing instance network info cache due to event network-changed-cf06308d-3f2e-40e2-b778-561b0c14eea0. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e44e5194-2a81-49e8-8d84-f2264f2fb1ed req-87e10ebe-c5e5-4615-b00b-a2a57687deb2 service nova] Acquiring lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e44e5194-2a81-49e8-8d84-f2264f2fb1ed req-87e10ebe-c5e5-4615-b00b-a2a57687deb2 service nova] Acquired lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG nova.network.neutron [req-e44e5194-2a81-49e8-8d84-f2264f2fb1ed req-87e10ebe-c5e5-4615-b00b-a2a57687deb2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Refreshing network info cache for port cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:24 user nova-compute[74889]: INFO nova.compute.manager [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Terminating instance
Nov 10 12:04:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG nova.network.neutron [req-e44e5194-2a81-49e8-8d84-f2264f2fb1ed req-87e10ebe-c5e5-4615-b00b-a2a57687deb2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updated VIF entry in instance network info cache for port cf06308d-3f2e-40e2-b778-561b0c14eea0. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG nova.network.neutron [req-e44e5194-2a81-49e8-8d84-f2264f2fb1ed req-87e10ebe-c5e5-4615-b00b-a2a57687deb2 service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating instance_info_cache with network_info: [{"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e44e5194-2a81-49e8-8d84-f2264f2fb1ed req-87e10ebe-c5e5-4615-b00b-a2a57687deb2 service nova] Releasing lock "refresh_cache-78fe06d2-9353-4b9a-8e34-2261f2f77fce" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Instance destroyed successfully.
Nov 10 12:04:25 user nova-compute[74889]: DEBUG nova.objects.instance [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lazy-loading 'resources' on Instance uuid 78fe06d2-9353-4b9a-8e34-2261f2f77fce {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T11:58:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1185042267',display_name='tempest-TestShelveInstance-server-1185042267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1185042267',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPodj8RVFRnA92GtRbLa/y5HXflW20ag/voq9r2ZeH0NpyQGRj3+WFhoAPh5CJmLOMRCKMA5LPKPCnUOg3GfcAzioslG0YE6FCboauaqDG5i1iJyS8KJnGXK3pKJSV0HRA==',key_name='tempest-TestShelveInstance-551479707',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:03:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63ecf83da57e42c893ec51707cc19d00',ramdisk_id='',reservation_id='r-5a4kdpl4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1459906128',owner_user_name='tempest-TestShelveInstance-1459906128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:03:14Z,user_data=None,user_id='02ca978ddde34a69944046e0ca2ad504',uuid=78fe06d2-9353-4b9a-8e34-2261f2f77fce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converting VIF {"id": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "address": "fa:16:3e:12:a0:f5", "network": {"id": "d94c55f7-0c71-40a0-b9d1-f171c42e737e", "bridge": "br-int", "label": "tempest-TestShelveInstance-2093755942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63ecf83da57e42c893ec51707cc19d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf06308d-3f", "ovs_interfaceid": "cf06308d-3f2e-40e2-b778-561b0c14eea0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_vif [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf06308d-3f, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e885d587-f74f-4a95-baef-b59511afb1dc) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:25 user nova-compute[74889]: INFO os_vif [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:a0:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf06308d-3f2e-40e2-b778-561b0c14eea0,network=Network(d94c55f7-0c71-40a0-b9d1-f171c42e737e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf06308d-3f')
Nov 10 12:04:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NuiXrEFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:04:25 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[96aed1d8-c4a3-4242-8e64-5eab25bee21e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:04:25 user nova-compute[74889]: No targets found.
Nov 10 12:04:25 user nova-compute[74889]: iSNS:
Nov 10 12:04:25 user nova-compute[74889]: No targets found.
Nov 10 12:04:25 user nova-compute[74889]: STATIC:
Nov 10 12:04:25 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a
Nov 10 12:04:25 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:04:25 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:04:25 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:04:25 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:04:25 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:04:25 user nova-compute[74889]: FIRMWARE:
Nov 10 12:04:25 user nova-compute[74889]: No targets found.
Nov 10 12:04:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:04:25 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:04:25 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c6b496-0c48-4971-ae01-915c3a5b50e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd44e779-c9e2-419a-8f79-f2e6b422dfa3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:04:25 user nova-compute[74889]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:04:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a (non-flash)
Nov 10 12:04:25 user nova-compute[74889]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:04:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3884efac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[636569f5-402a-45a9-bfe7-a9675fa6673c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6472915c-1a4f-469c-995f-083470d73f35]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5a24d1-4593-46c6-a46c-afae11c09d12]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5340ee-ad5b-45c3-9ead-e17189e89275]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f193c1fe-005e-4786-aeba-f3a26bddf038]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3608df0e-df13-4991-a631-fd93f89215f9]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260]
Nov 10 12:04:25 user nova-compute[74889]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a, portal: 172.16.0.220,3260] successful.
Nov 10 12:04:25 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9f23384-8a98-40fd-af08-babb064b0c5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[083a4a03-374f-42d5-b9ac-791cae7813aa]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] <== disconnect_volume: return (337ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:04:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Deleting instance files /opt/stack/data/nova/instances/78fe06d2-9353-4b9a-8e34-2261f2f77fce_del
Nov 10 12:04:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Deletion of /opt/stack/data/nova/instances/78fe06d2-9353-4b9a-8e34-2261f2f77fce_del complete
Nov 10 12:04:25 user nova-compute[74889]: INFO nova.compute.manager [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 10 12:04:25 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:04:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:26 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Took 0.50 seconds to deallocate network for instance.
Nov 10 12:04:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-vif-unplugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] No waiting events found dispatching network-vif-unplugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-vif-unplugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] Acquiring lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] No waiting events found dispatching network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:04:26 user nova-compute[74889]: WARNING nova.compute.manager [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received unexpected event network-vif-plugged-cf06308d-3f2e-40e2-b778-561b0c14eea0 for instance with vm_state active and task_state deleting.
Nov 10 12:04:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-20bbbe1a-1341-47c9-92a0-b53efb95f640 req-fedd3f5f-64be-45d3-88eb-79530c38a1de service nova] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Received event network-vif-deleted-cf06308d-3f2e-40e2-b778-561b0c14eea0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:27 user nova-compute[74889]: INFO nova.compute.manager [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Took 1.08 seconds to detach 1 volumes for instance.
Nov 10 12:04:27 user nova-compute[74889]: DEBUG nova.compute.manager [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] [instance: 78fe06d2-9353-4b9a-8e34-2261f2f77fce] Deleting volume: e9f23384-8a98-40fd-af08-babb064b0c5a {{(pid=74889) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 12:04:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:27 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:04:27 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:04:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:27 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Deleted allocations for instance 78fe06d2-9353-4b9a-8e34-2261f2f77fce
Nov 10 12:04:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-eb4158a4-bada-44ad-8267-b5a8b69af434 tempest-TestShelveInstance-1459906128 tempest-TestShelveInstance-1459906128-project-member] Lock "78fe06d2-9353-4b9a-8e34-2261f2f77fce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.503s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:28 user nova-compute[74889]: INFO nova.compute.manager [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Terminating instance
Nov 10 12:04:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-b38300f8-6a93-4b3c-99c1-55d04a68b33c req-6676c989-32fc-457d-8988-2b90cde3fb95 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received event network-vif-unplugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b38300f8-6a93-4b3c-99c1-55d04a68b33c req-6676c989-32fc-457d-8988-2b90cde3fb95 service nova] Acquiring lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b38300f8-6a93-4b3c-99c1-55d04a68b33c req-6676c989-32fc-457d-8988-2b90cde3fb95 service nova] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b38300f8-6a93-4b3c-99c1-55d04a68b33c req-6676c989-32fc-457d-8988-2b90cde3fb95 service nova] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-b38300f8-6a93-4b3c-99c1-55d04a68b33c req-6676c989-32fc-457d-8988-2b90cde3fb95 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] No waiting events found dispatching network-vif-unplugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-b38300f8-6a93-4b3c-99c1-55d04a68b33c req-6676c989-32fc-457d-8988-2b90cde3fb95 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received event network-vif-unplugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:04:28 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Instance destroyed successfully.
Nov 10 12:04:28 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'resources' on Instance uuid 93367290-6fa4-4bbe-b47b-2dfa27227bed {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-480762283',display_name='tempest-AttachVolumeNegativeTest-server-480762283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-480762283',id=16,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8d+/OpfsXA0MKlqL3YjZVtnaCmv9LS7/Q+r9D7QjLWvuFISJHe9VCnEnDjJEWJS0Pjf/zUQ3fFt0csaJxTtOojcoE0dofeG523Cjqb5T75ZHi/svH2e67ixAXmmCa8cg==',key_name='tempest-keypair-956495493',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-z8j7e8ce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=93367290-6fa4-4bbe-b47b-2dfa27227bed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:04:28 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "address": "fa:16:3e:fc:fa:dc", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01fa2c48-95", "ovs_interfaceid": "01fa2c48-958b-485c-b34e-b7ceb445bca4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:fa:dc,bridge_name='br-int',has_traffic_filtering=True,id=01fa2c48-958b-485c-b34e-b7ceb445bca4,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fa2c48-95') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG os_vif [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:fa:dc,bridge_name='br-int',has_traffic_filtering=True,id=01fa2c48-958b-485c-b34e-b7ceb445bca4,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fa2c48-95') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01fa2c48-95, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf38723d-2b3e-40bd-b108-444780e9d632) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:29 user nova-compute[74889]: INFO os_vif [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:fa:dc,bridge_name='br-int',has_traffic_filtering=True,id=01fa2c48-958b-485c-b34e-b7ceb445bca4,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01fa2c48-95')
Nov 10 12:04:29 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Deleting instance files /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed_del
Nov 10 12:04:29 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Deletion of /opt/stack/data/nova/instances/93367290-6fa4-4bbe-b47b-2dfa27227bed_del complete
Nov 10 12:04:29 user nova-compute[74889]: INFO nova.compute.manager [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 10 12:04:29 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:29 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:29 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Took 0.85 seconds to deallocate network for instance.
Nov 10 12:04:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-1f4b48c7-e096-40d2-ac5d-8299a99bd2fb req-c4ac1e00-a20e-4631-9b62-721f936be7d4 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received event network-vif-deleted-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:29 user nova-compute[74889]: INFO nova.compute.manager [req-1f4b48c7-e096-40d2-ac5d-8299a99bd2fb req-c4ac1e00-a20e-4631-9b62-721f936be7d4 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Neutron deleted interface 01fa2c48-958b-485c-b34e-b7ceb445bca4; detaching it from the instance and deleting it from the info cache
Nov 10 12:04:29 user nova-compute[74889]: DEBUG nova.network.neutron [req-1f4b48c7-e096-40d2-ac5d-8299a99bd2fb req-c4ac1e00-a20e-4631-9b62-721f936be7d4 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-1f4b48c7-e096-40d2-ac5d-8299a99bd2fb req-c4ac1e00-a20e-4631-9b62-721f936be7d4 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Detach interface failed, port_id=01fa2c48-958b-485c-b34e-b7ceb445bca4, reason: Instance 93367290-6fa4-4bbe-b47b-2dfa27227bed could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:30 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Deleted allocations for instance 93367290-6fa4-4bbe-b47b-2dfa27227bed
Nov 10 12:04:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9e81d62c-a086-4bb7-9464-446487fba5f7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.393s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4c29182-7daf-443d-976f-93b1ed124e4c req-2c955f8a-f5a4-440c-8d23-fb790e796999 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received event network-vif-plugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4c29182-7daf-443d-976f-93b1ed124e4c req-2c955f8a-f5a4-440c-8d23-fb790e796999 service nova] Acquiring lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4c29182-7daf-443d-976f-93b1ed124e4c req-2c955f8a-f5a4-440c-8d23-fb790e796999 service nova] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4c29182-7daf-443d-976f-93b1ed124e4c req-2c955f8a-f5a4-440c-8d23-fb790e796999 service nova] Lock "93367290-6fa4-4bbe-b47b-2dfa27227bed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4c29182-7daf-443d-976f-93b1ed124e4c req-2c955f8a-f5a4-440c-8d23-fb790e796999 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] No waiting events found dispatching network-vif-plugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:04:30 user nova-compute[74889]: WARNING nova.compute.manager [req-e4c29182-7daf-443d-976f-93b1ed124e4c req-2c955f8a-f5a4-440c-8d23-fb790e796999 service nova] [instance: 93367290-6fa4-4bbe-b47b-2dfa27227bed] Received unexpected event network-vif-plugged-01fa2c48-958b-485c-b34e-b7ceb445bca4 for instance with vm_state deleted and task_state None.
Nov 10 12:04:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:04:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:04:36 user nova-compute[74889]: INFO nova.compute.claims [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Claim successful on node user
Nov 10 12:04:37 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:04:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:04:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:04:37 user nova-compute[74889]: INFO nova.virt.block_device [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Booting with volume 891ad49b-fc2c-4a7d-a076-b163bb8f41d2 at /dev/vda
Nov 10 12:04:37 user nova-compute[74889]: DEBUG nova.policy [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ee603f962d94b498c975400029859a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe879f025d6b4b0088efafe9e1e57a6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG os_brick.utils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a959ff-41c7-48ec-b6da-42e2cd7a55e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cd5eb0-d4a2-4888-b0b6-1c34d6aca48b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d970c1c-8ada-4caa-b334-8eda69e0359b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa7c777-c270-43ec-a499-76b7e3f89319]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:04:37 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:04:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1a2b4b-752d-44f7-be26-1882d94303bf]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG os_brick.utils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:04:37 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating existing volume attachment record: 7b72258b-d008-4661-9cec-ea6256d1f8b8 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:04:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully created port: 27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:04:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully created port: 34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:04:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-2682f4ce-ada5-4e6b-823c-163085e78248 req-afc6b682-2144-41b0-a261-a72461873529 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received event network-changed-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-2682f4ce-ada5-4e6b-823c-163085e78248 req-afc6b682-2144-41b0-a261-a72461873529 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Refreshing instance network info cache due to event network-changed-02539ac7-b338-4419-8c36-f8683da00cb5. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2682f4ce-ada5-4e6b-823c-163085e78248 req-afc6b682-2144-41b0-a261-a72461873529 service nova] Acquiring lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2682f4ce-ada5-4e6b-823c-163085e78248 req-afc6b682-2144-41b0-a261-a72461873529 service nova] Acquired lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:39 user nova-compute[74889]: DEBUG nova.network.neutron [req-2682f4ce-ada5-4e6b-823c-163085e78248 req-afc6b682-2144-41b0-a261-a72461873529 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Refreshing network info cache for port 02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully created port: d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:04:39 user nova-compute[74889]: DEBUG nova.network.neutron [req-2682f4ce-ada5-4e6b-823c-163085e78248 req-afc6b682-2144-41b0-a261-a72461873529 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updated VIF entry in instance network info cache for port 02539ac7-b338-4419-8c36-f8683da00cb5. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:04:39 user nova-compute[74889]: DEBUG nova.network.neutron [req-2682f4ce-ada5-4e6b-823c-163085e78248 req-afc6b682-2144-41b0-a261-a72461873529 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updating instance_info_cache with network_info: [{"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2682f4ce-ada5-4e6b-823c-163085e78248 req-afc6b682-2144-41b0-a261-a72461873529 service nova] Releasing lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:40 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:04:40 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully created port: 4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Stashing vm_state: active {{(pid=74889) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-12c2572f-fe9b-4a08-a342-75d18d251aa1 req-d428739f-1811-4b6c-9ab4-7549d5a04b4a service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-changed-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-12c2572f-fe9b-4a08-a342-75d18d251aa1 req-d428739f-1811-4b6c-9ab4-7549d5a04b4a service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Refreshing instance network info cache due to event network-changed-ab97e0c2-49c1-4812-b8c5-ede04531a6f0. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-12c2572f-fe9b-4a08-a342-75d18d251aa1 req-d428739f-1811-4b6c-9ab4-7549d5a04b4a service nova] Acquiring lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-12c2572f-fe9b-4a08-a342-75d18d251aa1 req-d428739f-1811-4b6c-9ab4-7549d5a04b4a service nova] Acquired lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-12c2572f-fe9b-4a08-a342-75d18d251aa1 req-d428739f-1811-4b6c-9ab4-7549d5a04b4a service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Refreshing network info cache for port ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:41 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:04:41 user nova-compute[74889]: INFO nova.compute.claims [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Claim successful on node user
Nov 10 12:04:41 user nova-compute[74889]: INFO nova.compute.resource_tracker [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating resource usage from migration db62d8cd-0626-4682-9208-5c3b6302ff89
Nov 10 12:04:41 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully created port: af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.592s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:42 user nova-compute[74889]: INFO nova.compute.manager [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Migrating
Nov 10 12:04:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:42 user nova-compute[74889]: INFO nova.compute.rpcapi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 10 12:04:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.network.neutron [req-12c2572f-fe9b-4a08-a342-75d18d251aa1 req-d428739f-1811-4b6c-9ab4-7549d5a04b4a service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updated VIF entry in instance network info cache for port ab97e0c2-49c1-4812-b8c5-ede04531a6f0. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.network.neutron [req-12c2572f-fe9b-4a08-a342-75d18d251aa1 req-d428739f-1811-4b6c-9ab4-7549d5a04b4a service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating instance_info_cache with network_info: [{"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-12c2572f-fe9b-4a08-a342-75d18d251aa1 req-d428739f-1811-4b6c-9ab4-7549d5a04b4a service nova] Releasing lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquired lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully updated port: 27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-f5c82a1e-d75d-4f14-981b-4439fd9717db req-de07e4e9-150e-4092-a104-22fd09f02f97 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-changed-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-f5c82a1e-d75d-4f14-981b-4439fd9717db req-de07e4e9-150e-4092-a104-22fd09f02f97 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing instance network info cache due to event network-changed-27c48730-a168-4ccf-92d4-9e7d6aff5354. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f5c82a1e-d75d-4f14-981b-4439fd9717db req-de07e4e9-150e-4092-a104-22fd09f02f97 service nova] Acquiring lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f5c82a1e-d75d-4f14-981b-4439fd9717db req-de07e4e9-150e-4092-a104-22fd09f02f97 service nova] Acquired lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.network.neutron [req-f5c82a1e-d75d-4f14-981b-4439fd9717db req-de07e4e9-150e-4092-a104-22fd09f02f97 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing network info cache for port 27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating instance_info_cache with network_info: [{"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Releasing lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.network.neutron [req-f5c82a1e-d75d-4f14-981b-4439fd9717db req-de07e4e9-150e-4092-a104-22fd09f02f97 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Starting migrate_disk_and_power_off {{(pid=74889) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 12:04:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG nova.network.neutron [req-f5c82a1e-d75d-4f14-981b-4439fd9717db req-de07e4e9-150e-4092-a104-22fd09f02f97 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f5c82a1e-d75d-4f14-981b-4439fd9717db req-de07e4e9-150e-4092-a104-22fd09f02f97 service nova] Releasing lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully updated port: d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-b3323466-4f81-4adf-aeda-935b8187d86e req-32d70510-daa4-4763-8962-ba051038d2b7 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-vif-unplugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b3323466-4f81-4adf-aeda-935b8187d86e req-32d70510-daa4-4763-8962-ba051038d2b7 service nova] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b3323466-4f81-4adf-aeda-935b8187d86e req-32d70510-daa4-4763-8962-ba051038d2b7 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b3323466-4f81-4adf-aeda-935b8187d86e req-32d70510-daa4-4763-8962-ba051038d2b7 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-b3323466-4f81-4adf-aeda-935b8187d86e req-32d70510-daa4-4763-8962-ba051038d2b7 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] No waiting events found dispatching network-vif-unplugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:04:43 user nova-compute[74889]: WARNING nova.compute.manager [req-b3323466-4f81-4adf-aeda-935b8187d86e req-32d70510-daa4-4763-8962-ba051038d2b7 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received unexpected event network-vif-unplugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 for instance with vm_state active and task_state resize_migrating.
Nov 10 12:04:43 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Instance destroyed successfully.
Nov 10 12:04:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1298763924',display_name='tempest-ServerActionsTestOtherA-server-1298763924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1298763924',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV2sPROd86lDqNq7yn/OdL+EAGi3OrNcdrVAdLzqRGaXMCeQRt25LrQ3Ql1TrND/6Dz6MBX7QNwi3U9n4Q2xTxIhGV3gbETVuDolUvGcK3ZVpcr8zuoJBqyHEchy/q4SQ==',key_name='tempest-keypair-943743287',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:03:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-golc2jfc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=1aaa9255-2adb-4f1e-8952-af99a86fa99d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-894333280-network", "vif_mac": "fa:16:3e:45:07:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-894333280-network", "vif_mac": "fa:16:3e:45:07:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_vif [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab97e0c2-49, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62a8c7c2-cbd1-4aed-bc81-39074d67675b) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:04:43 user nova-compute[74889]: INFO os_vif [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49')
Nov 10 12:04:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHmMjaOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:04:43 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddc9a68-38a1-4358-a732-6eadf16b8d1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:04:43 user nova-compute[74889]: No targets found.
Nov 10 12:04:43 user nova-compute[74889]: iSNS:
Nov 10 12:04:43 user nova-compute[74889]: No targets found.
Nov 10 12:04:43 user nova-compute[74889]: STATIC:
Nov 10 12:04:43 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:04:43 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:04:43 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:04:43 user nova-compute[74889]: FIRMWARE:
Nov 10 12:04:43 user nova-compute[74889]: No targets found.
Nov 10 12:04:43 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:04:43 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:04:43 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9871b9fd-50d7-40dd-a569-311d83391a8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc63c2d0-f48c-455a-b85e-0f73cf02cc61]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:04:43 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:04:43 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa39823db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b'): ({'sdc'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Removing single pathed devices sdc {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[368057d2-cee8-4f6a-b174-d0ece95aa066]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fe1a5e-d441-4ed2-a67e-7da97ae7942c]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flushing IO for device /dev/sdc {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63e5e29-8435-47c5-b77e-bb69ddc8afb3]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b436c9a7-13c2-47ab-8229-d6dc5b3ea7a3]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26431333136633932', '/dev/disk/by-id/scsi-1SCST_BIO866b19c4-d1316c921c153794', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_866b19c4') {{(pid=85601) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ee4f29-a9ed-4a40-89f7-66591166d100]: (4, None) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b790df-1566-4541-84e8-f474c1051671]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e245971-e12a-461d-b2a7-da0ec6f72a7d]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260]
Nov 10 12:04:44 user nova-compute[74889]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260] successful.
Nov 10 12:04:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2d2d3b-2bf2-47b5-847f-b15d04cfcb38]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== disconnect_volume: return (468ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully updated port: 1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-changed-d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing instance network info cache due to event network-changed-d733429d-fba6-47de-b003-a9d5c4346e21. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] Acquiring lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] Acquired lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG nova.network.neutron [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing network info cache for port d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:44 user nova-compute[74889]: DEBUG nova.network.neutron [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully updated port: 34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG nova.network.neutron [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] Releasing lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-changed-1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing instance network info cache due to event network-changed-1abcaa96-1230-47d1-b313-c9a1a217747e. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] Acquiring lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] Acquired lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG nova.network.neutron [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing network info cache for port 1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG nova.network.neutron [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-6ae3f7a2-90d6-46c1-9a26-af5724e2ab94 req-406a7e38-b5de-4ef4-8c65-4e31644b30f7 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6ae3f7a2-90d6-46c1-9a26-af5724e2ab94 req-406a7e38-b5de-4ef4-8c65-4e31644b30f7 service nova] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6ae3f7a2-90d6-46c1-9a26-af5724e2ab94 req-406a7e38-b5de-4ef4-8c65-4e31644b30f7 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6ae3f7a2-90d6-46c1-9a26-af5724e2ab94 req-406a7e38-b5de-4ef4-8c65-4e31644b30f7 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-6ae3f7a2-90d6-46c1-9a26-af5724e2ab94 req-406a7e38-b5de-4ef4-8c65-4e31644b30f7 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] No waiting events found dispatching network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:04:45 user nova-compute[74889]: WARNING nova.compute.manager [req-6ae3f7a2-90d6-46c1-9a26-af5724e2ab94 req-406a7e38-b5de-4ef4-8c65-4e31644b30f7 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received unexpected event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 for instance with vm_state active and task_state resize_migrating.
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Port ab97e0c2-49c1-4812-b8c5-ede04531a6f0 binding to destination host user is already ACTIVE {{(pid=74889) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG nova.network.neutron [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-87729df7-cfd9-4cb8-b213-0805d8b10f89 req-c1cb823e-6e91-4ddd-9339-f536fe566706 service nova] Releasing lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully updated port: d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:46 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:04:46 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8089MB free_disk=25.44353485107422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Applying migration context for instance 1aaa9255-2adb-4f1e-8952-af99a86fa99d as it has an incoming, in-progress migration db62d8cd-0626-4682-9208-5c3b6302ff89. Migration status is post-migrating {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 12:04:46 user nova-compute[74889]: INFO nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating resource usage from migration db62d8cd-0626-4682-9208-5c3b6302ff89
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 22718082-4c44-4384-8692-c216bb1a14e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance b11fa594-7afe-4454-bbc2-e68a3564500e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 516ca546-b343-4d97-943d-05b975b57f79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Migration db62d8cd-0626-4682-9208-5c3b6302ff89 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 1aaa9255-2adb-4f1e-8952-af99a86fa99d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully updated port: 4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquired lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-changed-34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing instance network info cache due to event network-changed-34906c48-ea17-444c-985b-f9b356e0ccd9. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] Acquiring lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] Acquired lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing network info cache for port 34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] Releasing lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-changed-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing instance network info cache due to event network-changed-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] Acquiring lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] Acquired lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing network info cache for port d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.network.neutron [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating instance_info_cache with network_info: [{"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Releasing lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG os_brick.utils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fec4d2-357f-4ca0-ab75-d58921aa3d89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9b1442-2a40-4a67-b8ab-3b6a30ffcb72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b37f0b-b9eb-49bc-b5ea-f04189baed06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c22dbb7-5a14-4aa2-894f-45beb19deec8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:04:47 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[04613203-cdcd-429b-9548-034e7410305a]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG os_brick.utils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] Releasing lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-changed-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing instance network info cache due to event network-changed-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] Acquiring lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] Acquired lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing network info cache for port 4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-98982407-dd35-4818-9b97-76286093b035 req-bcc2b5d9-3417-4be8-b934-dec4400ac15f service nova] Releasing lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:48 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Successfully updated port: af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:04:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquired lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:48 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:04:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3980d5f-cda8-4105-9562-4387280afda1 req-8169239c-87c6-4744-85a3-21eeda922ac1 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-changed-af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:04:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3980d5f-cda8-4105-9562-4387280afda1 req-8169239c-87c6-4744-85a3-21eeda922ac1 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing instance network info cache due to event network-changed-af1150be-d621-4fff-8dc4-c296e3310ba7. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:04:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3980d5f-cda8-4105-9562-4387280afda1 req-8169239c-87c6-4744-85a3-21eeda922ac1 service nova] Acquiring lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:48 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKmMQGji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:04:49 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:04:49 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:04:49 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[358fa849-188f-44ae-9dad-45f3a5635f91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:04:49 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[559b2288-19c3-479e-a910-8e091ca45225]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529] added
Nov 10 12:04:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[39af7f0f-14f1-4aca-873f-210cc0b74991]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0afdbf-a101-4278-8920-dfa763c89e6a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKmMQGji {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PKmMQGji" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4da282e-04b1-4439-a356-f6da83bc342f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PKmMQGji'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c2e61-56a7-4fec-a157-ca90b22a7a14]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d4eb3d-df6b-42df-98d1-59bcd8545e35]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 12:04:49 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 12:04:49 user nova-compute[74889]:  {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:04:49 user nova-compute[74889]: WARNING os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 12:04:49 user nova-compute[74889]: 
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f09991-3977-43f6-8934-cd4abade433f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529, portal: 172.16.0.220,3260]
Nov 10 12:04:49 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529, portal: 172.16.0.220,3260] successful.
Nov 10 12:04:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab11d95-2ac1-47ea-a97b-778f4ab7a87c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[42331026-e2a2-4264-a81b-c44fbf7fc13e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:04:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:04:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[230d6c62-2c2e-4d0f-8a9b-68e0cd2f077d]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKmMQGji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:04:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:50 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:04:50 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23864643161656666', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:04:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864643161656666', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:04:50 user nova-compute[74889]: DEBUG nova.objects.instance [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid b11fa594-7afe-4454-bbc2-e68a3564500e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:04:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:04:50 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:04:50 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 12:04:50 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:04:50 user nova-compute[74889]:   <serial>a16e1e1e-0f83-4abe-bf3c-c849dd76a529</serial>
Nov 10 12:04:50 user nova-compute[74889]: </disk>
Nov 10 12:04:50 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:04:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:04:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:04:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No VIF found with MAC fa:16:3e:b1:11:4a, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-98e2f7d4-314b-4cd5-874d-304ebec61599 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.625s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [{"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Releasing lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance network_info: |[{"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3980d5f-cda8-4105-9562-4387280afda1 req-8169239c-87c6-4744-85a3-21eeda922ac1 service nova] Acquired lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-e3980d5f-cda8-4105-9562-4387280afda1 req-8169239c-87c6-4744-85a3-21eeda922ac1 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing network info cache for port af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-e3980d5f-cda8-4105-9562-4387280afda1 req-8169239c-87c6-4744-85a3-21eeda922ac1 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updated VIF entry in instance network info cache for port af1150be-d621-4fff-8dc4-c296e3310ba7. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-e3980d5f-cda8-4105-9562-4387280afda1 req-8169239c-87c6-4744-85a3-21eeda922ac1 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [{"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3980d5f-cda8-4105-9562-4387280afda1 req-8169239c-87c6-4744-85a3-21eeda922ac1 service nova] Releasing lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Updating instance_info_cache with network_info: [{"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:04:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:04:52 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:04:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:04:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG nova.objects.instance [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid b11fa594-7afe-4454-bbc2-e68a3564500e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:04:57 user nova-compute[74889]: INFO nova.compute.manager [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Attaching volume b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 to /dev/vdc
Nov 10 12:04:57 user nova-compute[74889]: DEBUG os_brick.utils [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c602983-27b7-48a9-8322-f8c5a694247a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5e4cc-f42d-486c-9cf2-7f462e37328c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe50378d-27a3-429d-b309-d8d6b47d2238]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d185005-1571-4162-aba6-11540bb65449]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:04:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:04:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:04:58 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:04:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eadd214-adbb-49a4-9aa2-a446b2c78ba4]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:04:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:04:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:04:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:04:58 user nova-compute[74889]: DEBUG os_brick.utils [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:04:58 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updating existing volume attachment record: 317a894d-ebb2-418a-b8a8-dd882a6e51ac {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:04:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:04 user nova-compute[74889]: INFO nova.virt.block_device [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Booting with volume e59e6264-c07d-4556-b4b5-41b88c204af0 at /dev/vdb
Nov 10 12:05:04 user nova-compute[74889]: DEBUG os_brick.utils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c52785-07e5-4582-836b-b75f24bdcdb0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06af5c0-39cf-4281-8385-d167f0065277]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b862793-8eab-4ed7-a8c4-1c8c79f33f2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[38000642-5c5e-401f-8cc5-b967bf312994]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:05:04 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:05:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e293bede-675f-43a1-9356-6873f8caf6f6]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG os_brick.utils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:05:04 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating existing volume attachment record: 919a4c60-f697-473b-b47a-2d6698aa62c4 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:05:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Starting finish_migration {{(pid=74889) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Instance directory exists: not creating {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 12:05:13 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Creating image(s)
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Ensure instance console log exists: /opt/stack/data/nova/instances/1aaa9255-2adb-4f1e-8952-af99a86fa99d/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Start _get_guest_xml network_info=[{"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-894333280-network", "vif_mac": "fa:16:3e:45:07:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHmMjaOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '1aaa9255-2adb-4f1e-8952-af99a86fa99d', 'attached_at': '2023-11-10T12:05:13.000000', 'detached_at': '', 'volume_id': '13562062-f66e-40d1-8de7-ef2d8d90ff7b', 'serial': '13562062-f66e-40d1-8de7-ef2d8d90ff7b'}, 'disk_bus': 'virtio', 'attachment_id': '67ecd702-1ff7-49a9-8642-a05274ccb28e', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:05:13 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:05:13 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHmMjaOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:05:13 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:05:13 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:05:13 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3befc12f-41d8-4982-84fb-bd8175a13f55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:05:13 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[de788187-6391-407e-bcc9-f9a487fe7007]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b] added
Nov 10 12:05:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8af7e2-e145-46ee-bed8-a9bea9f8c450]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d3f52b-fba6-4df2-bbd9-5b1809000b79]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHmMjaOU {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHmMjaOU" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0d8953-eb30-435c-8c13-e39488994772]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHmMjaOU'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68ff606-98c1-4aab-b794-d30b9cf5670c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f283433-f3f5-49b5-b990-eb03652a7566]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cc90f7-8203-4308-ac32-69642b9ffa37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260]
Nov 10 12:05:13 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260] successful.
Nov 10 12:05:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff50b9bb-c78a-4cfd-9b40-a1680ee30752]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24132f1-4d9c-44fd-aa99-56b486518dc1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:13 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:13 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a82fad6-bbba-4fd5-829f-bc37bdc94450]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:05:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHmMjaOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26431333136633932', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431333136633932', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1298763924',display_name='tempest-ServerActionsTestOtherA-server-1298763924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1298763924',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV2sPROd86lDqNq7yn/OdL+EAGi3OrNcdrVAdLzqRGaXMCeQRt25LrQ3Ql1TrND/6Dz6MBX7QNwi3U9n4Q2xTxIhGV3gbETVuDolUvGcK3ZVpcr8zuoJBqyHEchy/q4SQ==',key_name='tempest-keypair-943743287',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:03:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-golc2jfc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=1aaa9255-2adb-4f1e-8952-af99a86fa99d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-894333280-network", "vif_mac": "fa:16:3e:45:07:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-894333280-network", "vif_mac": "fa:16:3e:45:07:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:05:14 user nova-compute[74889]:   <uuid>1aaa9255-2adb-4f1e-8952-af99a86fa99d</uuid>
Nov 10 12:05:14 user nova-compute[74889]:   <name>instance-00000018</name>
Nov 10 12:05:14 user nova-compute[74889]:   <memory>2097152</memory>
Nov 10 12:05:14 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:05:14 user nova-compute[74889]:   <metadata>
Nov 10 12:05:14 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:05:14 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:05:14 user nova-compute[74889]:       <nova:name>tempest-ServerActionsTestOtherA-server-1298763924</nova:name>
Nov 10 12:05:14 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:05:13</nova:creationTime>
Nov 10 12:05:14 user nova-compute[74889]:       <nova:flavor name="m1.small">
Nov 10 12:05:14 user nova-compute[74889]:         <nova:memory>2048</nova:memory>
Nov 10 12:05:14 user nova-compute[74889]:         <nova:disk>20</nova:disk>
Nov 10 12:05:14 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:05:14 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:05:14 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:05:14 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:05:14 user nova-compute[74889]:       <nova:owner>
Nov 10 12:05:14 user nova-compute[74889]:         <nova:user uuid="8f4638ca003c46dab10aab2e5a2e6fb4">tempest-ServerActionsTestOtherA-631643283-project-member</nova:user>
Nov 10 12:05:14 user nova-compute[74889]:         <nova:project uuid="688cad5e5288440bb533d6e2c2f764c1">tempest-ServerActionsTestOtherA-631643283</nova:project>
Nov 10 12:05:14 user nova-compute[74889]:       </nova:owner>
Nov 10 12:05:14 user nova-compute[74889]:       <nova:ports>
Nov 10 12:05:14 user nova-compute[74889]:         <nova:port uuid="ab97e0c2-49c1-4812-b8c5-ede04531a6f0">
Nov 10 12:05:14 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:05:14 user nova-compute[74889]:         </nova:port>
Nov 10 12:05:14 user nova-compute[74889]:       </nova:ports>
Nov 10 12:05:14 user nova-compute[74889]:     </nova:instance>
Nov 10 12:05:14 user nova-compute[74889]:   </metadata>
Nov 10 12:05:14 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:05:14 user nova-compute[74889]:     <system>
Nov 10 12:05:14 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:05:14 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:05:14 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:05:14 user nova-compute[74889]:       <entry name="serial">1aaa9255-2adb-4f1e-8952-af99a86fa99d</entry>
Nov 10 12:05:14 user nova-compute[74889]:       <entry name="uuid">1aaa9255-2adb-4f1e-8952-af99a86fa99d</entry>
Nov 10 12:05:14 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:05:14 user nova-compute[74889]:     </system>
Nov 10 12:05:14 user nova-compute[74889]:   </sysinfo>
Nov 10 12:05:14 user nova-compute[74889]:   <os>
Nov 10 12:05:14 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:05:14 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:05:14 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:05:14 user nova-compute[74889]:   </os>
Nov 10 12:05:14 user nova-compute[74889]:   <features>
Nov 10 12:05:14 user nova-compute[74889]:     <acpi/>
Nov 10 12:05:14 user nova-compute[74889]:     <apic/>
Nov 10 12:05:14 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:05:14 user nova-compute[74889]:   </features>
Nov 10 12:05:14 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:05:14 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:05:14 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:05:14 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:05:14 user nova-compute[74889]:   </clock>
Nov 10 12:05:14 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:05:14 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:05:14 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:05:14 user nova-compute[74889]:   </cpu>
Nov 10 12:05:14 user nova-compute[74889]:   <devices>
Nov 10 12:05:14 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:05:14 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:05:14 user nova-compute[74889]:       <source dev="/dev/sdc"/>
Nov 10 12:05:14 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:05:14 user nova-compute[74889]:       <serial>13562062-f66e-40d1-8de7-ef2d8d90ff7b</serial>
Nov 10 12:05:14 user nova-compute[74889]:     </disk>
Nov 10 12:05:14 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:05:14 user nova-compute[74889]:       <mac address="fa:16:3e:45:07:09"/>
Nov 10 12:05:14 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:05:14 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:05:14 user nova-compute[74889]:       <target dev="tapab97e0c2-49"/>
Nov 10 12:05:14 user nova-compute[74889]:     </interface>
Nov 10 12:05:14 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:05:14 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/1aaa9255-2adb-4f1e-8952-af99a86fa99d/console.log" append="off"/>
Nov 10 12:05:14 user nova-compute[74889]:     </serial>
Nov 10 12:05:14 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:05:14 user nova-compute[74889]:     <video>
Nov 10 12:05:14 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:05:14 user nova-compute[74889]:     </video>
Nov 10 12:05:14 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:05:14 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:05:14 user nova-compute[74889]:     </rng>
Nov 10 12:05:14 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:05:14 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:05:14 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:05:14 user nova-compute[74889]:     </memballoon>
Nov 10 12:05:14 user nova-compute[74889]:   </devices>
Nov 10 12:05:14 user nova-compute[74889]: </domain>
Nov 10 12:05:14 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1298763924',display_name='tempest-ServerActionsTestOtherA-server-1298763924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1298763924',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV2sPROd86lDqNq7yn/OdL+EAGi3OrNcdrVAdLzqRGaXMCeQRt25LrQ3Ql1TrND/6Dz6MBX7QNwi3U9n4Q2xTxIhGV3gbETVuDolUvGcK3ZVpcr8zuoJBqyHEchy/q4SQ==',key_name='tempest-keypair-943743287',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:03:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-golc2jfc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=1aaa9255-2adb-4f1e-8952-af99a86fa99d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-894333280-network", "vif_mac": "fa:16:3e:45:07:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-894333280-network", "vif_mac": "fa:16:3e:45:07:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG os_vif [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '770b8a58-d812-52d3-86c2-e296765bdeb0', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab97e0c2-49, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab97e0c2-49, col_values=(('qos', UUID('cc594008-8991-4ee1-976a-ff1101f7c410')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab97e0c2-49, col_values=(('external_ids', {'iface-id': 'ab97e0c2-49c1-4812-b8c5-ede04531a6f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:07:09', 'vm-uuid': '1aaa9255-2adb-4f1e-8952-af99a86fa99d'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:14 user nova-compute[74889]: INFO os_vif [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49')
Nov 10 12:05:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:05:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] No VIF found with MAC fa:16:3e:45:07:09, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:05:16 user nova-compute[74889]: INFO nova.compute.claims [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Claim successful on node user
Nov 10 12:05:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-2848c3f4-3441-4059-ae99-dc3a0f1be1a8 req-3ca75853-72fd-4f17-aaae-33a877e0a4e0 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2848c3f4-3441-4059-ae99-dc3a0f1be1a8 req-3ca75853-72fd-4f17-aaae-33a877e0a4e0 service nova] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2848c3f4-3441-4059-ae99-dc3a0f1be1a8 req-3ca75853-72fd-4f17-aaae-33a877e0a4e0 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2848c3f4-3441-4059-ae99-dc3a0f1be1a8 req-3ca75853-72fd-4f17-aaae-33a877e0a4e0 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-2848c3f4-3441-4059-ae99-dc3a0f1be1a8 req-3ca75853-72fd-4f17-aaae-33a877e0a4e0 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] No waiting events found dispatching network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:05:16 user nova-compute[74889]: WARNING nova.compute.manager [req-2848c3f4-3441-4059-ae99-dc3a0f1be1a8 req-3ca75853-72fd-4f17-aaae-33a877e0a4e0 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received unexpected event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 for instance with vm_state active and task_state resize_finish.
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.148s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:05:16 user nova-compute[74889]: INFO nova.compute.claims [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Claim successful on node user
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.network.neutron [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:05:16 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:05:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:05:17 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Creating image(s)
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "/opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "/opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "/opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.026s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.policy [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '109e2f18063546d48270f3ae95fae53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a044fadd3c4420e8eedda7501a12114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.233s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:17 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk 1073741824" returned: 0 in 0.064s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.policy [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b53b32c4dd094fb4a4b0618dc619b21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e703b195816426d9054c28fa6cd15cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:05:17 user nova-compute[74889]: INFO nova.virt.block_device [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Booting with volume f9e012f6-ebd0-4c52-a368-c65b82b54147 at /dev/vda
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG os_brick.utils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a694f0-f03f-463c-914f-998d54493309]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29d745a-82bd-4dd3-8351-d2b47cfdd3a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f7af0-3776-4197-a4e0-a6757be6757b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[802df0e0-2dd9-4b8f-ae91-cfcc15741f0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:05:18 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9d255c-317d-4b4c-af21-3fd2e641022a]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG os_brick.utils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Updating existing volume attachment record: d4df3206-b55f-4167-9d59-29fb4a2cbc45 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Cannot resize image /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Ensure instance console log exists: /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG nova.network.neutron [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Successfully created port: 4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:05:18 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Instance running successfully.
Nov 10 12:05:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Failed to set time: agent not configured {{(pid=74889) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-80b30432-0f60-4c05-ac83-2e3a2ebd16c6 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] finish_migration finished successfully. {{(pid=74889) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-373bf75a-f95a-4dbd-a4e5-1394970b25a8 req-06dea315-2ea7-4cd6-a0d5-aeee62346312 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-373bf75a-f95a-4dbd-a4e5-1394970b25a8 req-06dea315-2ea7-4cd6-a0d5-aeee62346312 service nova] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-373bf75a-f95a-4dbd-a4e5-1394970b25a8 req-06dea315-2ea7-4cd6-a0d5-aeee62346312 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-373bf75a-f95a-4dbd-a4e5-1394970b25a8 req-06dea315-2ea7-4cd6-a0d5-aeee62346312 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-373bf75a-f95a-4dbd-a4e5-1394970b25a8 req-06dea315-2ea7-4cd6-a0d5-aeee62346312 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] No waiting events found dispatching network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:05:18 user nova-compute[74889]: WARNING nova.compute.manager [req-373bf75a-f95a-4dbd-a4e5-1394970b25a8 req-06dea315-2ea7-4cd6-a0d5-aeee62346312 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received unexpected event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 for instance with vm_state active and task_state resize_finish.
Nov 10 12:05:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Successfully created port: 999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.network.neutron [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Successfully updated port: 4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "refresh_cache-c12c5975-867c-46fb-897a-1adc16ab47b3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquired lock "refresh_cache-c12c5975-867c-46fb-897a-1adc16ab47b3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.network.neutron [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.network.neutron [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.network.neutron [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Updating instance_info_cache with network_info: [{"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Releasing lock "refresh_cache-c12c5975-867c-46fb-897a-1adc16ab47b3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Instance network_info: |[{"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Start _get_guest_xml network_info=[{"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:05:19 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:05:19 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-161383283',display_name='tempest-VolumesSnapshotTestJSON-instance-161383283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-161383283',id=29,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ95yd6ziBJMdBUjitURX1/RLTPKTJySg+FweKNLw5ashF8AOkAiB/545ARSPhGyGkeXuRhcuH8wQ0OqKRqQG2wmdgU1ELT/8S/uuytM12nzHekGvPGfciPwF9biGPqxKA==',key_name='tempest-keypair-1175125015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a044fadd3c4420e8eedda7501a12114',ramdisk_id='',reservation_id='r-sbvu3720',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2146398887',owner_user_name='tempest-VolumesSnapshotTestJSON-2146398887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='109e2f18063546d48270f3ae95fae53d',uuid=c12c5975-867c-46fb-897a-1adc16ab47b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converting VIF {"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a7:50,bridge_name='br-int',has_traffic_filtering=True,id=4637bfab-a1e0-4684-a3e2-f140baf0b1f0,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4637bfab-a1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.objects.instance [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lazy-loading 'pci_devices' on Instance uuid c12c5975-867c-46fb-897a-1adc16ab47b3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:05:19 user nova-compute[74889]:   <uuid>c12c5975-867c-46fb-897a-1adc16ab47b3</uuid>
Nov 10 12:05:19 user nova-compute[74889]:   <name>instance-0000001d</name>
Nov 10 12:05:19 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:05:19 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:05:19 user nova-compute[74889]:   <metadata>
Nov 10 12:05:19 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:05:19 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:05:19 user nova-compute[74889]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-161383283</nova:name>
Nov 10 12:05:19 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:05:19</nova:creationTime>
Nov 10 12:05:19 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:05:19 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:05:19 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:05:19 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:05:19 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:05:19 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:05:19 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:05:19 user nova-compute[74889]:       <nova:owner>
Nov 10 12:05:19 user nova-compute[74889]:         <nova:user uuid="109e2f18063546d48270f3ae95fae53d">tempest-VolumesSnapshotTestJSON-2146398887-project-member</nova:user>
Nov 10 12:05:19 user nova-compute[74889]:         <nova:project uuid="5a044fadd3c4420e8eedda7501a12114">tempest-VolumesSnapshotTestJSON-2146398887</nova:project>
Nov 10 12:05:19 user nova-compute[74889]:       </nova:owner>
Nov 10 12:05:19 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:05:19 user nova-compute[74889]:       <nova:ports>
Nov 10 12:05:19 user nova-compute[74889]:         <nova:port uuid="4637bfab-a1e0-4684-a3e2-f140baf0b1f0">
Nov 10 12:05:19 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 12:05:19 user nova-compute[74889]:         </nova:port>
Nov 10 12:05:19 user nova-compute[74889]:       </nova:ports>
Nov 10 12:05:19 user nova-compute[74889]:     </nova:instance>
Nov 10 12:05:19 user nova-compute[74889]:   </metadata>
Nov 10 12:05:19 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:05:19 user nova-compute[74889]:     <system>
Nov 10 12:05:19 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:05:19 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:05:19 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:05:19 user nova-compute[74889]:       <entry name="serial">c12c5975-867c-46fb-897a-1adc16ab47b3</entry>
Nov 10 12:05:19 user nova-compute[74889]:       <entry name="uuid">c12c5975-867c-46fb-897a-1adc16ab47b3</entry>
Nov 10 12:05:19 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:05:19 user nova-compute[74889]:     </system>
Nov 10 12:05:19 user nova-compute[74889]:   </sysinfo>
Nov 10 12:05:19 user nova-compute[74889]:   <os>
Nov 10 12:05:19 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:05:19 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:05:19 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:05:19 user nova-compute[74889]:   </os>
Nov 10 12:05:19 user nova-compute[74889]:   <features>
Nov 10 12:05:19 user nova-compute[74889]:     <acpi/>
Nov 10 12:05:19 user nova-compute[74889]:     <apic/>
Nov 10 12:05:19 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:05:19 user nova-compute[74889]:   </features>
Nov 10 12:05:19 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:05:19 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:05:19 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:05:19 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:05:19 user nova-compute[74889]:   </clock>
Nov 10 12:05:19 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:05:19 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:05:19 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:05:19 user nova-compute[74889]:   </cpu>
Nov 10 12:05:19 user nova-compute[74889]:   <devices>
Nov 10 12:05:19 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:05:19 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:05:19 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk"/>
Nov 10 12:05:19 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:05:19 user nova-compute[74889]:     </disk>
Nov 10 12:05:19 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:05:19 user nova-compute[74889]:       <mac address="fa:16:3e:f1:a7:50"/>
Nov 10 12:05:19 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:05:19 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:05:19 user nova-compute[74889]:       <target dev="tap4637bfab-a1"/>
Nov 10 12:05:19 user nova-compute[74889]:     </interface>
Nov 10 12:05:19 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:05:19 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/console.log" append="off"/>
Nov 10 12:05:19 user nova-compute[74889]:     </serial>
Nov 10 12:05:19 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:05:19 user nova-compute[74889]:     <video>
Nov 10 12:05:19 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:05:19 user nova-compute[74889]:     </video>
Nov 10 12:05:19 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:05:19 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:05:19 user nova-compute[74889]:     </rng>
Nov 10 12:05:19 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:05:19 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:05:19 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:05:19 user nova-compute[74889]:     </memballoon>
Nov 10 12:05:19 user nova-compute[74889]:   </devices>
Nov 10 12:05:19 user nova-compute[74889]: </domain>
Nov 10 12:05:19 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-161383283',display_name='tempest-VolumesSnapshotTestJSON-instance-161383283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-161383283',id=29,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ95yd6ziBJMdBUjitURX1/RLTPKTJySg+FweKNLw5ashF8AOkAiB/545ARSPhGyGkeXuRhcuH8wQ0OqKRqQG2wmdgU1ELT/8S/uuytM12nzHekGvPGfciPwF9biGPqxKA==',key_name='tempest-keypair-1175125015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a044fadd3c4420e8eedda7501a12114',ramdisk_id='',reservation_id='r-sbvu3720',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2146398887',owner_user_name='tempest-VolumesSnapshotTestJSON-2146398887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:05:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='109e2f18063546d48270f3ae95fae53d',uuid=c12c5975-867c-46fb-897a-1adc16ab47b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converting VIF {"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a7:50,bridge_name='br-int',has_traffic_filtering=True,id=4637bfab-a1e0-4684-a3e2-f140baf0b1f0,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4637bfab-a1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG os_vif [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a7:50,bridge_name='br-int',has_traffic_filtering=True,id=4637bfab-a1e0-4684-a3e2-f140baf0b1f0,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4637bfab-a1') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e22c111f-b166-51ad-9751-5a06ee99f4e1', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4637bfab-a1, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4637bfab-a1, col_values=(('qos', UUID('2982528c-31d2-4d2c-a26a-3c1ad5182be3')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4637bfab-a1, col_values=(('external_ids', {'iface-id': '4637bfab-a1e0-4684-a3e2-f140baf0b1f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:a7:50', 'vm-uuid': 'c12c5975-867c-46fb-897a-1adc16ab47b3'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:05:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:19 user nova-compute[74889]: INFO os_vif [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:a7:50,bridge_name='br-int',has_traffic_filtering=True,id=4637bfab-a1e0-4684-a3e2-f140baf0b1f0,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4637bfab-a1')
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] No VIF found with MAC fa:16:3e:f1:a7:50, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Successfully updated port: 999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquired lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-6013030b-fcb8-428f-8abe-28a367776c58 req-e5ceb75e-5af8-4a73-a011-482f98ab1877 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-changed-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-6013030b-fcb8-428f-8abe-28a367776c58 req-e5ceb75e-5af8-4a73-a011-482f98ab1877 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Refreshing instance network info cache due to event network-changed-999a321c-2987-4a20-8414-da97331a6a9d. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6013030b-fcb8-428f-8abe-28a367776c58 req-e5ceb75e-5af8-4a73-a011-482f98ab1877 service nova] Acquiring lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-1ad8c291-ee6b-4757-a04a-96d4a08ec643 req-b058de50-048a-4b08-b0f0-c6b66659b89f service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received event network-changed-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-1ad8c291-ee6b-4757-a04a-96d4a08ec643 req-b058de50-048a-4b08-b0f0-c6b66659b89f service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Refreshing instance network info cache due to event network-changed-4637bfab-a1e0-4684-a3e2-f140baf0b1f0. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1ad8c291-ee6b-4757-a04a-96d4a08ec643 req-b058de50-048a-4b08-b0f0-c6b66659b89f service nova] Acquiring lock "refresh_cache-c12c5975-867c-46fb-897a-1adc16ab47b3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1ad8c291-ee6b-4757-a04a-96d4a08ec643 req-b058de50-048a-4b08-b0f0-c6b66659b89f service nova] Acquired lock "refresh_cache-c12c5975-867c-46fb-897a-1adc16ab47b3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.network.neutron [req-1ad8c291-ee6b-4757-a04a-96d4a08ec643 req-b058de50-048a-4b08-b0f0-c6b66659b89f service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Refreshing network info cache for port 4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Updating instance_info_cache with network_info: [{"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Releasing lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Instance network_info: |[{"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6013030b-fcb8-428f-8abe-28a367776c58 req-e5ceb75e-5af8-4a73-a011-482f98ab1877 service nova] Acquired lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:05:20 user nova-compute[74889]: DEBUG nova.network.neutron [req-6013030b-fcb8-428f-8abe-28a367776c58 req-e5ceb75e-5af8-4a73-a011-482f98ab1877 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Refreshing network info cache for port 999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:05:21 user nova-compute[74889]: DEBUG nova.network.neutron [req-6013030b-fcb8-428f-8abe-28a367776c58 req-e5ceb75e-5af8-4a73-a011-482f98ab1877 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Updated VIF entry in instance network info cache for port 999a321c-2987-4a20-8414-da97331a6a9d. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:05:21 user nova-compute[74889]: DEBUG nova.network.neutron [req-6013030b-fcb8-428f-8abe-28a367776c58 req-e5ceb75e-5af8-4a73-a011-482f98ab1877 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Updating instance_info_cache with network_info: [{"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:05:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6013030b-fcb8-428f-8abe-28a367776c58 req-e5ceb75e-5af8-4a73-a011-482f98ab1877 service nova] Releasing lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:05:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:21 user nova-compute[74889]: DEBUG nova.network.neutron [req-1ad8c291-ee6b-4757-a04a-96d4a08ec643 req-b058de50-048a-4b08-b0f0-c6b66659b89f service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Updated VIF entry in instance network info cache for port 4637bfab-a1e0-4684-a3e2-f140baf0b1f0. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:05:21 user nova-compute[74889]: DEBUG nova.network.neutron [req-1ad8c291-ee6b-4757-a04a-96d4a08ec643 req-b058de50-048a-4b08-b0f0-c6b66659b89f service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Updating instance_info_cache with network_info: [{"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:05:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1ad8c291-ee6b-4757-a04a-96d4a08ec643 req-b058de50-048a-4b08-b0f0-c6b66659b89f service nova] Releasing lock "refresh_cache-c12c5975-867c-46fb-897a-1adc16ab47b3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received event network-vif-plugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] No waiting events found dispatching network-vif-plugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:05:22 user nova-compute[74889]: WARNING nova.compute.manager [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received unexpected event network-vif-plugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 for instance with vm_state building and task_state spawning.
Nov 10 12:05:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received event network-vif-plugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] No waiting events found dispatching network-vif-plugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:05:22 user nova-compute[74889]: WARNING nova.compute.manager [req-14321fd6-337d-49c4-91f8-fe5aab11fa1a req-0cc9e067-d860-44af-b89a-5e6f44e2aaf3 service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received unexpected event network-vif-plugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 for instance with vm_state building and task_state spawning.
Nov 10 12:05:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-a6fb5853-dfd5-421f-8677-ba93ae0aca5f req-1137eac5-a436-48cb-8842-014cbca2e70c service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received event network-changed-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-a6fb5853-dfd5-421f-8677-ba93ae0aca5f req-1137eac5-a436-48cb-8842-014cbca2e70c service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Refreshing instance network info cache due to event network-changed-5991ae27-b6df-46f7-bf1d-bf4eea8c4592. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a6fb5853-dfd5-421f-8677-ba93ae0aca5f req-1137eac5-a436-48cb-8842-014cbca2e70c service nova] Acquiring lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a6fb5853-dfd5-421f-8677-ba93ae0aca5f req-1137eac5-a436-48cb-8842-014cbca2e70c service nova] Acquired lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:05:22 user nova-compute[74889]: DEBUG nova.network.neutron [req-a6fb5853-dfd5-421f-8677-ba93ae0aca5f req-1137eac5-a436-48cb-8842-014cbca2e70c service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Refreshing network info cache for port 5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:05:23 user nova-compute[74889]: DEBUG nova.network.neutron [req-a6fb5853-dfd5-421f-8677-ba93ae0aca5f req-1137eac5-a436-48cb-8842-014cbca2e70c service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Updated VIF entry in instance network info cache for port 5991ae27-b6df-46f7-bf1d-bf4eea8c4592. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:05:23 user nova-compute[74889]: DEBUG nova.network.neutron [req-a6fb5853-dfd5-421f-8677-ba93ae0aca5f req-1137eac5-a436-48cb-8842-014cbca2e70c service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Updating instance_info_cache with network_info: [{"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:05:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a6fb5853-dfd5-421f-8677-ba93ae0aca5f req-1137eac5-a436-48cb-8842-014cbca2e70c service nova] Releasing lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:05:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:05:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Instance spawned successfully.
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:24 user nova-compute[74889]: INFO nova.compute.manager [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Took 7.16 seconds to spawn the instance on the hypervisor.
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:24 user nova-compute[74889]: INFO nova.compute.manager [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Took 8.15 seconds to build instance.
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-32478cd3-5c15-4804-aed2-50221b99526d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.310s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvsfFbYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:05:24 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:05:24 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:05:24 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6c70d7-e19b-4ecb-8584-336d5b0c3005]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:05:24 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4625c3-f2c7-44e0-b1cd-c389acfa6fbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4] added
Nov 10 12:05:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32ac1e1-6070-42c7-9e22-fcf989f47594]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "14b9e652-8956-4e69-96e1-0677c49381f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "14b9e652-8956-4e69-96e1-0677c49381f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[615508a4-7dd0-4242-af3f-036380562e4d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvsfFbYB {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvsfFbYB" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2116e164-474f-44cc-b249-622d81bcc1c9]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MvsfFbYB'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b52a9c-7792-493b-9aef-061cb7ecb144]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b85598-815d-4d83-a0f7-3f276a31bc76]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:24 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:24 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:05:24 user nova-compute[74889]: INFO nova.compute.claims [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Claim successful on node user
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4189e374-a5c2-4c11-91f0-fd5f205853db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4, portal: 172.16.0.220,3260]
Nov 10 12:05:24 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4, portal: 172.16.0.220,3260] successful.
Nov 10 12:05:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb255980-fc00-432c-a50a-da1a7c30b193]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[152b11ac-aca5-4d94-8b14-68d4a459f4de]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:24 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:24 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:05:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:24 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:24 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:05:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5ce4e9-5b0f-4d64-8f9b-fbd71f0a477e]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvsfFbYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:05:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.network.neutron [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:05:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.policy [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3485bf67f27e4b72868b0adc1225bfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6ad4f23d94494b3f42cdbc7fd4516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:05:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Creating image(s)
Nov 10 12:05:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "/opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "/opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "/opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23631663535383566', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631663535383566', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:05:25 user nova-compute[74889]: DEBUG nova.objects.instance [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid b11fa594-7afe-4454-bbc2-e68a3564500e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:05:26 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:05:26 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:05:26 user nova-compute[74889]:   <target dev="vdc" bus="virtio"/>
Nov 10 12:05:26 user nova-compute[74889]:   <serial>b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4</serial>
Nov 10 12:05:26 user nova-compute[74889]: </disk>
Nov 10 12:05:26 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.257s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk 1073741824" returned: 0 in 0.092s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] No VIF found with MAC fa:16:3e:b1:11:4a, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.295s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG nova.network.neutron [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Successfully created port: 9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Cannot resize image /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Ensure instance console log exists: /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edf1040b-7ac8-4f96-aefc-dac63e4e5661 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.581s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Successfully updated port: 9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:05:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "refresh_cache-14b9e652-8956-4e69-96e1-0677c49381f1" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:05:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquired lock "refresh_cache-14b9e652-8956-4e69-96e1-0677c49381f1" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:05:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:05:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-35bd2474-bf3f-4a95-8b0e-f46cab53ecfb req-f2c999c5-ea12-4e6d-9a50-a8d90ca7e394 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received event network-changed-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-35bd2474-bf3f-4a95-8b0e-f46cab53ecfb req-f2c999c5-ea12-4e6d-9a50-a8d90ca7e394 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Refreshing instance network info cache due to event network-changed-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:05:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-35bd2474-bf3f-4a95-8b0e-f46cab53ecfb req-f2c999c5-ea12-4e6d-9a50-a8d90ca7e394 service nova] Acquiring lock "refresh_cache-14b9e652-8956-4e69-96e1-0677c49381f1" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:05:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:28 user nova-compute[74889]: INFO nova.compute.manager [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Detaching volume a16e1e1e-0f83-4abe-bf3c-c849dd76a529
Nov 10 12:05:28 user nova-compute[74889]: INFO nova.virt.block_device [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Attempting to driver detach volume a16e1e1e-0f83-4abe-bf3c-c849dd76a529 from mountpoint /dev/vdb
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Attempting to detach device vdb from instance b11fa594-7afe-4454-bbc2-e68a3564500e from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:05:28 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:05:28 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 12:05:28 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:05:28 user nova-compute[74889]:   <serial>a16e1e1e-0f83-4abe-bf3c-c849dd76a529</serial>
Nov 10 12:05:28 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:05:28 user nova-compute[74889]: </disk>
Nov 10 12:05:28 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.network.neutron [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Updating instance_info_cache with network_info: [{"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:05:28 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully detached device vdb from instance b11fa594-7afe-4454-bbc2-e68a3564500e from the persistent domain config.
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b11fa594-7afe-4454-bbc2-e68a3564500e from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:05:28 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:05:28 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 12:05:28 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:05:28 user nova-compute[74889]:   <serial>a16e1e1e-0f83-4abe-bf3c-c849dd76a529</serial>
Nov 10 12:05:28 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:05:28 user nova-compute[74889]: </disk>
Nov 10 12:05:28 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Releasing lock "refresh_cache-14b9e652-8956-4e69-96e1-0677c49381f1" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Instance network_info: |[{"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-35bd2474-bf3f-4a95-8b0e-f46cab53ecfb req-f2c999c5-ea12-4e6d-9a50-a8d90ca7e394 service nova] Acquired lock "refresh_cache-14b9e652-8956-4e69-96e1-0677c49381f1" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-35bd2474-bf3f-4a95-8b0e-f46cab53ecfb req-f2c999c5-ea12-4e6d-9a50-a8d90ca7e394 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Refreshing network info cache for port 9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Start _get_guest_xml network_info=[{"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:05:28 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:05:28 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1888790662',display_name='tempest-AttachVolumeNegativeTest-server-1888790662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1888790662',id=31,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMVO1hyiGoVRGq3XnzjpCNNk3d4GAnfmGRzx7KY86YNK1sZ+d2XjHGhJS7zGF8uLDA2t9NT7Mb1n8kUsrQx0hqbjXINYrGUXcDyl6dg/q26JcPvb/YPXwOyCZiLqXV8BQ==',key_name='tempest-keypair-1720494258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-77pheh5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=14b9e652-8956-4e69-96e1-0677c49381f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a0:cd,bridge_name='br-int',has_traffic_filtering=True,id=9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db03fd1-e7') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.objects.instance [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'pci_devices' on Instance uuid 14b9e652-8956-4e69-96e1-0677c49381f1 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:05:28 user nova-compute[74889]:   <uuid>14b9e652-8956-4e69-96e1-0677c49381f1</uuid>
Nov 10 12:05:28 user nova-compute[74889]:   <name>instance-0000001f</name>
Nov 10 12:05:28 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:05:28 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:05:28 user nova-compute[74889]:   <metadata>
Nov 10 12:05:28 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:05:28 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:05:28 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1888790662</nova:name>
Nov 10 12:05:28 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:05:28</nova:creationTime>
Nov 10 12:05:28 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:05:28 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:05:28 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:05:28 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:05:28 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:05:28 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:05:28 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:05:28 user nova-compute[74889]:       <nova:owner>
Nov 10 12:05:28 user nova-compute[74889]:         <nova:user uuid="3485bf67f27e4b72868b0adc1225bfeb">tempest-AttachVolumeNegativeTest-238498304-project-member</nova:user>
Nov 10 12:05:28 user nova-compute[74889]:         <nova:project uuid="80c6ad4f23d94494b3f42cdbc7fd4516">tempest-AttachVolumeNegativeTest-238498304</nova:project>
Nov 10 12:05:28 user nova-compute[74889]:       </nova:owner>
Nov 10 12:05:28 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:05:28 user nova-compute[74889]:       <nova:ports>
Nov 10 12:05:28 user nova-compute[74889]:         <nova:port uuid="9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3">
Nov 10 12:05:28 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 12:05:28 user nova-compute[74889]:         </nova:port>
Nov 10 12:05:28 user nova-compute[74889]:       </nova:ports>
Nov 10 12:05:28 user nova-compute[74889]:     </nova:instance>
Nov 10 12:05:28 user nova-compute[74889]:   </metadata>
Nov 10 12:05:28 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:05:28 user nova-compute[74889]:     <system>
Nov 10 12:05:28 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:05:28 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:05:28 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:05:28 user nova-compute[74889]:       <entry name="serial">14b9e652-8956-4e69-96e1-0677c49381f1</entry>
Nov 10 12:05:28 user nova-compute[74889]:       <entry name="uuid">14b9e652-8956-4e69-96e1-0677c49381f1</entry>
Nov 10 12:05:28 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:05:28 user nova-compute[74889]:     </system>
Nov 10 12:05:28 user nova-compute[74889]:   </sysinfo>
Nov 10 12:05:28 user nova-compute[74889]:   <os>
Nov 10 12:05:28 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:05:28 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:05:28 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:05:28 user nova-compute[74889]:   </os>
Nov 10 12:05:28 user nova-compute[74889]:   <features>
Nov 10 12:05:28 user nova-compute[74889]:     <acpi/>
Nov 10 12:05:28 user nova-compute[74889]:     <apic/>
Nov 10 12:05:28 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:05:28 user nova-compute[74889]:   </features>
Nov 10 12:05:28 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:05:28 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:05:28 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:05:28 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:05:28 user nova-compute[74889]:   </clock>
Nov 10 12:05:28 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:05:28 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:05:28 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:05:28 user nova-compute[74889]:   </cpu>
Nov 10 12:05:28 user nova-compute[74889]:   <devices>
Nov 10 12:05:28 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:05:28 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:05:28 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk"/>
Nov 10 12:05:28 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:05:28 user nova-compute[74889]:     </disk>
Nov 10 12:05:28 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:05:28 user nova-compute[74889]:       <mac address="fa:16:3e:f4:a0:cd"/>
Nov 10 12:05:28 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:05:28 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:05:28 user nova-compute[74889]:       <target dev="tap9db03fd1-e7"/>
Nov 10 12:05:28 user nova-compute[74889]:     </interface>
Nov 10 12:05:28 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:05:28 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/console.log" append="off"/>
Nov 10 12:05:28 user nova-compute[74889]:     </serial>
Nov 10 12:05:28 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:05:28 user nova-compute[74889]:     <video>
Nov 10 12:05:28 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:05:28 user nova-compute[74889]:     </video>
Nov 10 12:05:28 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:05:28 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:05:28 user nova-compute[74889]:     </rng>
Nov 10 12:05:28 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:05:28 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:05:28 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:05:28 user nova-compute[74889]:     </memballoon>
Nov 10 12:05:28 user nova-compute[74889]:   </devices>
Nov 10 12:05:28 user nova-compute[74889]: </domain>
Nov 10 12:05:28 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1888790662',display_name='tempest-AttachVolumeNegativeTest-server-1888790662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1888790662',id=31,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMVO1hyiGoVRGq3XnzjpCNNk3d4GAnfmGRzx7KY86YNK1sZ+d2XjHGhJS7zGF8uLDA2t9NT7Mb1n8kUsrQx0hqbjXINYrGUXcDyl6dg/q26JcPvb/YPXwOyCZiLqXV8BQ==',key_name='tempest-keypair-1720494258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-77pheh5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=14b9e652-8956-4e69-96e1-0677c49381f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a0:cd,bridge_name='br-int',has_traffic_filtering=True,id=9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db03fd1-e7') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG os_vif [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a0:cd,bridge_name='br-int',has_traffic_filtering=True,id=9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db03fd1-e7') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f776e4b4-18d4-5e16-9068-c0a79463b229', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9db03fd1-e7, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9db03fd1-e7, col_values=(('qos', UUID('e1010ad8-babb-4956-a791-f18eae77696d')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9db03fd1-e7, col_values=(('external_ids', {'iface-id': '9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:a0:cd', 'vm-uuid': '14b9e652-8956-4e69-96e1-0677c49381f1'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:28 user nova-compute[74889]: INFO os_vif [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:a0:cd,bridge_name='br-int',has_traffic_filtering=True,id=9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db03fd1-e7')
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No VIF found with MAC fa:16:3e:f4:a0:cd, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-35bd2474-bf3f-4a95-8b0e-f46cab53ecfb req-f2c999c5-ea12-4e6d-9a50-a8d90ca7e394 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Updated VIF entry in instance network info cache for port 9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-35bd2474-bf3f-4a95-8b0e-f46cab53ecfb req-f2c999c5-ea12-4e6d-9a50-a8d90ca7e394 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Updating instance_info_cache with network_info: [{"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-35bd2474-bf3f-4a95-8b0e-f46cab53ecfb req-f2c999c5-ea12-4e6d-9a50-a8d90ca7e394 service nova] Releasing lock "refresh_cache-14b9e652-8956-4e69-96e1-0677c49381f1" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:05:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b11fa594-7afe-4454-bbc2-e68a3564500e {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:05:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-e108f17c-edc8-4394-8f70-716bf7ea4c72 req-93afd87c-dd38-4141-a316-21dbcb159846 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received event network-vif-plugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e108f17c-edc8-4394-8f70-716bf7ea4c72 req-93afd87c-dd38-4141-a316-21dbcb159846 service nova] Acquiring lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e108f17c-edc8-4394-8f70-716bf7ea4c72 req-93afd87c-dd38-4141-a316-21dbcb159846 service nova] Lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e108f17c-edc8-4394-8f70-716bf7ea4c72 req-93afd87c-dd38-4141-a316-21dbcb159846 service nova] Lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-e108f17c-edc8-4394-8f70-716bf7ea4c72 req-93afd87c-dd38-4141-a316-21dbcb159846 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] No waiting events found dispatching network-vif-plugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:05:30 user nova-compute[74889]: WARNING nova.compute.manager [req-e108f17c-edc8-4394-8f70-716bf7ea4c72 req-93afd87c-dd38-4141-a316-21dbcb159846 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received unexpected event network-vif-plugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 for instance with vm_state building and task_state spawning.
Nov 10 12:05:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:32 user nova-compute[74889]: INFO nova.virt.block_device [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Booting with volume 095c018d-6937-489d-b155-97dded277605 at /dev/vdc
Nov 10 12:05:32 user nova-compute[74889]: DEBUG os_brick.utils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5bde7c-ef37-45f6-8f3d-9d705dc5998e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0f149b-cfeb-473b-ab6e-cb23c7e56391]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a83231-3fad-4c1c-af08-0cce51b616b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa3b8ee-1052-408b-ad6b-b63d7a677d38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:05:32 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[762e7eaa-981e-46f7-ab93-90ea34584680]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG os_brick.utils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating existing volume attachment record: c88bd2fe-36fe-4cbb-b170-def38aa1ef17 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-275774d2-a73e-4df5-960f-32eb97c889d9 req-857a312a-bb88-4c13-b0d3-c2249326eaee service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received event network-vif-plugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-275774d2-a73e-4df5-960f-32eb97c889d9 req-857a312a-bb88-4c13-b0d3-c2249326eaee service nova] Acquiring lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-275774d2-a73e-4df5-960f-32eb97c889d9 req-857a312a-bb88-4c13-b0d3-c2249326eaee service nova] Lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-275774d2-a73e-4df5-960f-32eb97c889d9 req-857a312a-bb88-4c13-b0d3-c2249326eaee service nova] Lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-275774d2-a73e-4df5-960f-32eb97c889d9 req-857a312a-bb88-4c13-b0d3-c2249326eaee service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] No waiting events found dispatching network-vif-plugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:05:32 user nova-compute[74889]: WARNING nova.compute.manager [req-275774d2-a73e-4df5-960f-32eb97c889d9 req-857a312a-bb88-4c13-b0d3-c2249326eaee service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received unexpected event network-vif-plugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 for instance with vm_state building and task_state spawning.
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:05:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Instance spawned successfully.
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:32 user nova-compute[74889]: INFO nova.compute.manager [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Took 7.24 seconds to spawn the instance on the hypervisor.
Nov 10 12:05:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:05:33 user nova-compute[74889]: INFO nova.compute.manager [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Took 8.31 seconds to build instance.
Nov 10 12:05:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-35c1c809-52a2-43ab-b684-25c301dfd2c6 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "14b9e652-8956-4e69-96e1-0677c49381f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.459s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:05:41 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:05:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:05:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:05:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:44 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:05:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:05:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:05:47 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Creating image(s)
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Ensure instance console log exists: /opt/stack/data/nova/instances/0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Start _get_guest_xml network_info=[{"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txAzlibn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9e012f6-ebd0-4c52-a368-c65b82b54147', 'serial': 'f9e012f6-ebd0-4c52-a368-c65b82b54147'}, 'disk_bus': 'virtio', 'attachment_id': 'd4df3206-b55f-4167-9d59-29fb4a2cbc45', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:05:47 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:05:47 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txAzlibn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:05:47 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:05:47 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:05:47 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3210fc6-9fa8-4a73-967f-118810be402c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:05:47 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fcdd10-d5d0-4389-a23c-6d08ec4df1d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147] added
Nov 10 12:05:47 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ddd38d-32de-4dc6-92bc-0870593eb38d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af6af50-6ea6-4fdf-a276-03b499927dd2]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txAzlibn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v txAzlibn" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b217ffe-1f46-42a6-bf64-983cc695baee]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'txAzlibn'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG nova.objects.instance [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'flavor' on Instance uuid a37438e5-4f27-439c-a9f9-c3f9aa396d94 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[00214504-6356-4507-b45e-4e3137323f12]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18fc5f5-c851-4d9e-a0bb-397b15f244ba]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:48 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:48 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:05:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:48 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:48 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:05:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.478s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:48 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:05:48 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7713MB free_disk=25.401832580566406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44411df-fa83-4891-8abd-094b9da881be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147, portal: 172.16.0.220,3260]
Nov 10 12:05:48 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147, portal: 172.16.0.220,3260] successful.
Nov 10 12:05:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34f61fb-c7bd-4123-98e2-28e74c762e23]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac6271a-d058-4868-87e9-047a84d6b2c1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:48 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:48 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:05:48 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:05:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:48 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:48 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:05:48 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:05:48 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.743s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f00146f-e922-468c-b68e-0bffa7edb043]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:48 user nova-compute[74889]: INFO nova.compute.manager [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Attaching volume fcfa18dd-feb7-4f7e-a414-5b98a470dab1 to /dev/vdb
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Applying migration context for instance 1aaa9255-2adb-4f1e-8952-af99a86fa99d as it has an incoming, in-progress migration db62d8cd-0626-4682-9208-5c3b6302ff89. Migration status is finished {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 12:05:48 user nova-compute[74889]: INFO nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating resource usage from migration db62d8cd-0626-4682-9208-5c3b6302ff89
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 22718082-4c44-4384-8692-c216bb1a14e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance b11fa594-7afe-4454-bbc2-e68a3564500e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 516ca546-b343-4d97-943d-05b975b57f79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Migration db62d8cd-0626-4682-9208-5c3b6302ff89 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 1aaa9255-2adb-4f1e-8952-af99a86fa99d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance c12c5975-867c-46fb-897a-1adc16ab47b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 14b9e652-8956-4e69-96e1-0677c49381f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.utils [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2537e6-9d02-44fd-ab53-22ab120f5dcb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa97d8d-27a2-4223-a3eb-af6f582975eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b2f5de-0ad3-41e5-b186-cfd4ce1c82dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abb2b8a-524c-44f3-b19d-961eb987b83c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:05:48 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dcff4f-20aa-4ff9-beba-667c2efb6316]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.utils [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updating existing volume attachment record: eb014705-f0e0-430f-90cd-5a4828fbd16f {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:48 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b11fa594-7afe-4454-bbc2-e68a3564500e is timed out.
Nov 10 12:05:48 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully detached device vdb from instance b11fa594-7afe-4454-bbc2-e68a3564500e from the live domain config.
Nov 10 12:05:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PKmMQGji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:05:48 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:05:48 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txAzlibn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.775s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== connect_volume: return (1776ms) {'type': 'block', 'scsi_wwn': '23632383266346661', 'path': '/dev/sde'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632383266346661', 'path': '/dev/sde'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.301s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5633ad4-ce9c-4b6f-9a69-09f207406ced]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-414501121',display_name='tempest-TestVolumeBootPattern-volume-backed-server-414501121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-414501121',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApwhofCLbU4Sp4Fsx1xBuM107AQwjVPzFnvvXXi7l5q3yl8qq+VcB4PiHnjcnTj4HW+6e0/mA9RK7SDUBmtzbdax9K0wUQKup/OPIs98MdomgtgfzR8gSsoYq9SjYPbWw==',key_name='tempest-keypair-1691904880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-snhjp70j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:83,bridge_name='br-int',has_traffic_filtering=True,id=999a321c-2987-4a20-8414-da97331a6a9d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999a321c-29') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:05:49 user nova-compute[74889]: No targets found.
Nov 10 12:05:49 user nova-compute[74889]: iSNS:
Nov 10 12:05:49 user nova-compute[74889]: No targets found.
Nov 10 12:05:49 user nova-compute[74889]: STATIC:
Nov 10 12:05:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:05:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:05:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:05:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4
Nov 10 12:05:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:05:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:05:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:05:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:05:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:05:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529
Nov 10 12:05:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:05:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:05:49 user nova-compute[74889]: FIRMWARE:
Nov 10 12:05:49 user nova-compute[74889]: No targets found.
Nov 10 12:05:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:05:49 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:05:49 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:05:49 user nova-compute[74889]:   <uuid>0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb</uuid>
Nov 10 12:05:49 user nova-compute[74889]:   <name>instance-0000001e</name>
Nov 10 12:05:49 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:05:49 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:05:49 user nova-compute[74889]:   <metadata>
Nov 10 12:05:49 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:05:49 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:05:49 user nova-compute[74889]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-414501121</nova:name>
Nov 10 12:05:49 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:05:47</nova:creationTime>
Nov 10 12:05:49 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:05:49 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:05:49 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:05:49 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:05:49 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:05:49 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:05:49 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:05:49 user nova-compute[74889]:       <nova:owner>
Nov 10 12:05:49 user nova-compute[74889]:         <nova:user uuid="b53b32c4dd094fb4a4b0618dc619b21f">tempest-TestVolumeBootPattern-1577456798-project-member</nova:user>
Nov 10 12:05:49 user nova-compute[74889]:         <nova:project uuid="1e703b195816426d9054c28fa6cd15cc">tempest-TestVolumeBootPattern-1577456798</nova:project>
Nov 10 12:05:49 user nova-compute[74889]:       </nova:owner>
Nov 10 12:05:49 user nova-compute[74889]:       <nova:ports>
Nov 10 12:05:49 user nova-compute[74889]:         <nova:port uuid="999a321c-2987-4a20-8414-da97331a6a9d">
Nov 10 12:05:49 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 12:05:49 user nova-compute[74889]:         </nova:port>
Nov 10 12:05:49 user nova-compute[74889]:       </nova:ports>
Nov 10 12:05:49 user nova-compute[74889]:     </nova:instance>
Nov 10 12:05:49 user nova-compute[74889]:   </metadata>
Nov 10 12:05:49 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:05:49 user nova-compute[74889]:     <system>
Nov 10 12:05:49 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:05:49 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:05:49 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:05:49 user nova-compute[74889]:       <entry name="serial">0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb</entry>
Nov 10 12:05:49 user nova-compute[74889]:       <entry name="uuid">0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb</entry>
Nov 10 12:05:49 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:05:49 user nova-compute[74889]:     </system>
Nov 10 12:05:49 user nova-compute[74889]:   </sysinfo>
Nov 10 12:05:49 user nova-compute[74889]:   <os>
Nov 10 12:05:49 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:05:49 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:05:49 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:05:49 user nova-compute[74889]:   </os>
Nov 10 12:05:49 user nova-compute[74889]:   <features>
Nov 10 12:05:49 user nova-compute[74889]:     <acpi/>
Nov 10 12:05:49 user nova-compute[74889]:     <apic/>
Nov 10 12:05:49 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:05:49 user nova-compute[74889]:   </features>
Nov 10 12:05:49 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:05:49 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:05:49 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:05:49 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:05:49 user nova-compute[74889]:   </clock>
Nov 10 12:05:49 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:05:49 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:05:49 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:05:49 user nova-compute[74889]:   </cpu>
Nov 10 12:05:49 user nova-compute[74889]:   <devices>
Nov 10 12:05:49 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:05:49 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:05:49 user nova-compute[74889]:       <source dev="/dev/sde"/>
Nov 10 12:05:49 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:05:49 user nova-compute[74889]:       <serial>f9e012f6-ebd0-4c52-a368-c65b82b54147</serial>
Nov 10 12:05:49 user nova-compute[74889]:     </disk>
Nov 10 12:05:49 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:05:49 user nova-compute[74889]:       <mac address="fa:16:3e:dd:68:83"/>
Nov 10 12:05:49 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:05:49 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:05:49 user nova-compute[74889]:       <target dev="tap999a321c-29"/>
Nov 10 12:05:49 user nova-compute[74889]:     </interface>
Nov 10 12:05:49 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:05:49 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb/console.log" append="off"/>
Nov 10 12:05:49 user nova-compute[74889]:     </serial>
Nov 10 12:05:49 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:05:49 user nova-compute[74889]:     <video>
Nov 10 12:05:49 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:05:49 user nova-compute[74889]:     </video>
Nov 10 12:05:49 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:05:49 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:05:49 user nova-compute[74889]:     </rng>
Nov 10 12:05:49 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:05:49 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:05:49 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:05:49 user nova-compute[74889]:     </memballoon>
Nov 10 12:05:49 user nova-compute[74889]:   </devices>
Nov 10 12:05:49 user nova-compute[74889]: </domain>
Nov 10 12:05:49 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-414501121',display_name='tempest-TestVolumeBootPattern-volume-backed-server-414501121',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-414501121',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApwhofCLbU4Sp4Fsx1xBuM107AQwjVPzFnvvXXi7l5q3yl8qq+VcB4PiHnjcnTj4HW+6e0/mA9RK7SDUBmtzbdax9K0wUQKup/OPIs98MdomgtgfzR8gSsoYq9SjYPbWw==',key_name='tempest-keypair-1691904880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-snhjp70j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:83,bridge_name='br-int',has_traffic_filtering=True,id=999a321c-2987-4a20-8414-da97331a6a9d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999a321c-29') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_vif [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:83,bridge_name='br-int',has_traffic_filtering=True,id=999a321c-2987-4a20-8414-da97331a6a9d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999a321c-29') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c43789e2-a33c-5193-a7d2-2551e758e31a', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f202d1f-7b75-4958-bd6e-3b16f9d5a4fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap999a321c-29, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap999a321c-29, col_values=(('qos', UUID('eadaf01a-9c44-46cf-b0cc-70e80f26be3f')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap999a321c-29, col_values=(('external_ids', {'iface-id': '999a321c-2987-4a20-8414-da97331a6a9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:68:83', 'vm-uuid': '0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:49 user nova-compute[74889]: INFO os_vif [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:68:83,bridge_name='br-int',has_traffic_filtering=True,id=999a321c-2987-4a20-8414-da97331a6a9d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999a321c-29')
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11a53d4-2537-4016-bfe6-631a514eec1e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:49 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:49 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:05:49 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:05:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 (non-flash)
Nov 10 12:05:49 user nova-compute[74889]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:05:49 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:05:49 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:05:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a01d2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[761f1b8d-8f37-4adc-9c6a-d271a058a860]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e23898-af6c-47c2-9a73-ea8724fbbde5]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dc4298-eeab-4f2a-a9a7-c5531053c7d5]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] No VIF found with MAC fa:16:3e:dd:68:83, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2a428a-12d0-4923-b6f4-50acc8160f19]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[501c5f6a-aede-4580-8b4a-0442b295003f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[798cbe9f-3acf-44bf-a84b-a041570bb44d]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529, portal: 172.16.0.220,3260]
Nov 10 12:05:49 user nova-compute[74889]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529, portal: 172.16.0.220,3260] successful.
Nov 10 12:05:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a16e1e1e-0f83-4abe-bf3c-c849dd76a529 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff14a6f-eedd-45e3-8def-5ce037eb4d2a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== disconnect_volume: return (629ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:05:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG nova.objects.instance [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid b11fa594-7afe-4454-bbc2-e68a3564500e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-67942023-6943-4763-957f-fc58633ce7c9 tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.487s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:50 user nova-compute[74889]: INFO nova.compute.manager [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Detaching volume b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4
Nov 10 12:05:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-9bbe4eaf-87c4-4a93-bd68-15f5c36d76e9 req-85a2bcbf-7f31-4ce0-b680-cc6132cbea06 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9bbe4eaf-87c4-4a93-bd68-15f5c36d76e9 req-85a2bcbf-7f31-4ce0-b680-cc6132cbea06 service nova] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9bbe4eaf-87c4-4a93-bd68-15f5c36d76e9 req-85a2bcbf-7f31-4ce0-b680-cc6132cbea06 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9bbe4eaf-87c4-4a93-bd68-15f5c36d76e9 req-85a2bcbf-7f31-4ce0-b680-cc6132cbea06 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-9bbe4eaf-87c4-4a93-bd68-15f5c36d76e9 req-85a2bcbf-7f31-4ce0-b680-cc6132cbea06 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] No waiting events found dispatching network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:05:50 user nova-compute[74889]: WARNING nova.compute.manager [req-9bbe4eaf-87c4-4a93-bd68-15f5c36d76e9 req-85a2bcbf-7f31-4ce0-b680-cc6132cbea06 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received unexpected event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d for instance with vm_state building and task_state spawning.
Nov 10 12:05:51 user nova-compute[74889]: INFO nova.virt.block_device [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Attempting to driver detach volume b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 from mountpoint /dev/vdc
Nov 10 12:05:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Attempting to detach device vdc from instance b11fa594-7afe-4454-bbc2-e68a3564500e from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:05:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:05:51 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:05:51 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:05:51 user nova-compute[74889]:   <target dev="vdc" bus="virtio"/>
Nov 10 12:05:51 user nova-compute[74889]:   <serial>b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4</serial>
Nov 10 12:05:51 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 12:05:51 user nova-compute[74889]: </disk>
Nov 10 12:05:51 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:05:51 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully detached device vdc from instance b11fa594-7afe-4454-bbc2-e68a3564500e from the persistent domain config.
Nov 10 12:05:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b11fa594-7afe-4454-bbc2-e68a3564500e from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:05:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:05:51 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:05:51 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:05:51 user nova-compute[74889]:   <target dev="vdc" bus="virtio"/>
Nov 10 12:05:51 user nova-compute[74889]:   <serial>b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4</serial>
Nov 10 12:05:51 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 12:05:51 user nova-compute[74889]: </disk>
Nov 10 12:05:51 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:05:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b11fa594-7afe-4454-bbc2-e68a3564500e {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:05:52 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:05:52 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:05:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:05:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:05:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:05:52 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.compute.manager [req-e1fa03f6-3020-483b-bc3b-fda6e94e46d4 req-1d7736cd-b5cd-431d-905c-a72b00f3ca97 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e1fa03f6-3020-483b-bc3b-fda6e94e46d4 req-1d7736cd-b5cd-431d-905c-a72b00f3ca97 service nova] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e1fa03f6-3020-483b-bc3b-fda6e94e46d4 req-1d7736cd-b5cd-431d-905c-a72b00f3ca97 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e1fa03f6-3020-483b-bc3b-fda6e94e46d4 req-1d7736cd-b5cd-431d-905c-a72b00f3ca97 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.compute.manager [req-e1fa03f6-3020-483b-bc3b-fda6e94e46d4 req-1d7736cd-b5cd-431d-905c-a72b00f3ca97 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] No waiting events found dispatching network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:05:53 user nova-compute[74889]: WARNING nova.compute.manager [req-e1fa03f6-3020-483b-bc3b-fda6e94e46d4 req-1d7736cd-b5cd-431d-905c-a72b00f3ca97 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received unexpected event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d for instance with vm_state building and task_state spawning.
Nov 10 12:05:53 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Instance spawned successfully.
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:05:53 user nova-compute[74889]: INFO nova.compute.manager [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:05:53 user nova-compute[74889]: INFO nova.compute.manager [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Took 36.60 seconds to build instance.
Nov 10 12:05:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e8b5bdb3-c78b-4bc9-b586-6c9139414159 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.732s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updating instance_info_cache with network_info: [{"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-b11fa594-7afe-4454-bbc2-e68a3564500e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:05:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:05:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:05:54 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:05:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:05:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:06:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Creating image(s)
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Ensure instance console log exists: /opt/stack/data/nova/instances/c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Start _get_guest_xml network_info=[{"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzbikVmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3', 'attached_at': '', 'detached_at': '', 'volume_id': '891ad49b-fc2c-4a7d-a076-b163bb8f41d2', 'serial': '891ad49b-fc2c-4a7d-a076-b163bb8f41d2'}, 'disk_bus': 'virtio', 'attachment_id': '7b72258b-d008-4661-9cec-ea6256d1f8b8', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXgnbFUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3', 'attached_at': '', 'detached_at': '', 'volume_id': 'e59e6264-c07d-4556-b4b5-41b88c204af0', 'serial': 'e59e6264-c07d-4556-b4b5-41b88c204af0'}, 'disk_bus': 'virtio', 'attachment_id': '919a4c60-f697-473b-b47a-2d6698aa62c4', 'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFfcsbmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3', 'attached_at': '', 'detached_at': '', 'volume_id': '095c018d-6937-489d-b155-97dded277605', 'serial': '095c018d-6937-489d-b155-97dded277605'}, 'disk_bus': 'virtio', 'attachment_id': 'c88bd2fe-36fe-4cbb-b170-def38aa1ef17', 'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:06:00 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:06:00 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzbikVmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:06:00 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:06:00 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:06:00 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d28b3e-53d2-4ddd-9d6d-177585f28362]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:06:00 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1461e09-62f8-4478-8d43-47b8a906794b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2] added
Nov 10 12:06:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ba4da1-9aea-4a34-b442-791370ad87ea]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e310897-fec0-45ca-8ae4-38af3bd50872]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzbikVmQ {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzbikVmQ" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a5f49a-6f35-4a26-a7d7-904b24eff298]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GzbikVmQ'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46453dd-3738-434d-9706-49307f258859]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bde8ece-32c2-412d-b876-b890d81300f4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:00 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:00 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:00 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:00 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3922a6-6068-4da6-9b74-655561b38ab5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2, portal: 172.16.0.220,3260]
Nov 10 12:06:00 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2, portal: 172.16.0.220,3260] successful.
Nov 10 12:06:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a53171e-051b-42a6-af82-0c0a3cf94f35]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[081ca7ff-5e1c-46c9-8c5d-83f51f9b9916]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:00 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:00 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:00 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:00 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:00 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:00 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd288077-a104-491b-8b4a-b19c361ab23c]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:06:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzbikVmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:06:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:06:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23766396637346265', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:06:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766396637346265', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:06:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:06:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXgnbFUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:06:01 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:06:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:06:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:06:01 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:06:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:06:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:06:01 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:06:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[219acdc4-02dc-4ab2-b163-34ca72577fe1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:06:02 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3646924-e249-47a8-9a66-255b58243630]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0] added
Nov 10 12:06:02 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a6f2da-c8e0-4fcb-9945-357f7c6fbe5a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d92da25-ee0a-4f3a-8b09-851f1b9f9545]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXgnbFUa {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jXgnbFUa" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd9c40-990a-465a-8270-1dc328d8ad5a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jXgnbFUa'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b8cfd0-f77d-4a8d-9e4f-e31489ba78a0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17813a5-533a-4453-bfa6-2025cb004461]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf9c036-fbc2-43ee-bfd9-67c628014240]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0, portal: 172.16.0.220,3260]
Nov 10 12:06:02 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0, portal: 172.16.0.220,3260] successful.
Nov 10 12:06:02 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc5f909-f985-4418-a6f5-bf289dbf0258]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fd4f7c-246c-457b-99cc-a47f098d2103]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:02 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b58b0b-3d3d-4330-b22b-cd0b905d7dd2]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:06:02 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXgnbFUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23936363530383534', 'path': '/dev/sdf'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936363530383534', 'path': '/dev/sdf'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFfcsbmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:06:03 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:06:03 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:06:03 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[936786ba-7bdf-463a-8df6-694a68d706e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:06:03 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee43c11-7bf4-4531-bcdd-02ad6400c52c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605] added
Nov 10 12:06:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f673c877-fbfe-46a1-b3ac-a930acbccce8]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0004301f-16da-4b78-bed4-e3b1af4231f9]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFfcsbmQ {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFfcsbmQ" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ebee42-c1a0-4f6c-8b11-58e966aad4b8]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFfcsbmQ'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f50b7a-c3b3-4ee2-925a-96672e2ae66c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cdebfd-542f-410f-87b6-b1eb2f93581e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[675e6a6f-fda7-47a3-a153-82bda44cb6ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605, portal: 172.16.0.220,3260]
Nov 10 12:06:03 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605, portal: 172.16.0.220,3260] successful.
Nov 10 12:06:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9938e1-64ed-4d9d-ba30-b641c3bc5b41]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4151cf11-79d5-4a4c-886c-8a0911b71101]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)
Nov 10 12:06:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] HCTL ('38', '-', '-', 0) found on session 32 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[97049c27-22ca-448b-9863-6d756c253398]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Searching for a device in session 32 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:06:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFfcsbmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26138643033626238', 'path': '/dev/sdg'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138643033626238', 'path': '/dev/sdg'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=27c48730-a168-4ccf-92d4-9e7d6aff5354,network=Network(6b96d1cd-7c4f-4821-bb85-166b161ef722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c48730-a1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:93,bridge_name='br-int',has_traffic_filtering=True,id=d733429d-fba6-47de-b003-a9d5c4346e21,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd733429d-fb') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:87:cb,bridge_name='br-int',has_traffic_filtering=True,id=1abcaa96-1230-47d1-b313-c9a1a217747e,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1abcaa96-12') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d3:08,bridge_name='br-int',has_traffic_filtering=True,id=34906c48-ea17-444c-985b-f9b356e0ccd9,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34906c48-ea') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=d9cbe8cb-6d2c-4288-8582-4b6b240f97d1,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cbe8cb-6d') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4e3ef5-97') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d8:b0,bridge_name='br-int',has_traffic_filtering=True,id=af1150be-d621-4fff-8dc4-c296e3310ba7,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1150be-d6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lazy-loading 'pci_devices' on Instance uuid c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:06:04 user nova-compute[74889]:   <uuid>c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3</uuid>
Nov 10 12:06:04 user nova-compute[74889]:   <name>instance-0000001c</name>
Nov 10 12:06:04 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:06:04 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:06:04 user nova-compute[74889]:   <metadata>
Nov 10 12:06:04 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:06:04 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:06:04 user nova-compute[74889]:       <nova:name>tempest-device-tagging-server-1980518752</nova:name>
Nov 10 12:06:04 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:06:00</nova:creationTime>
Nov 10 12:06:04 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:06:04 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:06:04 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:06:04 user nova-compute[74889]:       <nova:owner>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:user uuid="0ee603f962d94b498c975400029859a9">tempest-TaggedBootDevicesTest-1528117072-project-member</nova:user>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:project uuid="fe879f025d6b4b0088efafe9e1e57a6e">tempest-TaggedBootDevicesTest-1528117072</nova:project>
Nov 10 12:06:04 user nova-compute[74889]:       </nova:owner>
Nov 10 12:06:04 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:06:04 user nova-compute[74889]:       <nova:ports>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:port uuid="27c48730-a168-4ccf-92d4-9e7d6aff5354">
Nov 10 12:06:04 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 12:06:04 user nova-compute[74889]:         </nova:port>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:port uuid="d733429d-fba6-47de-b003-a9d5c4346e21">
Nov 10 12:06:04 user nova-compute[74889]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
Nov 10 12:06:04 user nova-compute[74889]:         </nova:port>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:port uuid="1abcaa96-1230-47d1-b313-c9a1a217747e">
Nov 10 12:06:04 user nova-compute[74889]:           <nova:ip type="fixed" address="10.1.1.128" ipVersion="4"/>
Nov 10 12:06:04 user nova-compute[74889]:         </nova:port>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:port uuid="34906c48-ea17-444c-985b-f9b356e0ccd9">
Nov 10 12:06:04 user nova-compute[74889]:           <nova:ip type="fixed" address="10.1.1.152" ipVersion="4"/>
Nov 10 12:06:04 user nova-compute[74889]:         </nova:port>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:port uuid="d9cbe8cb-6d2c-4288-8582-4b6b240f97d1">
Nov 10 12:06:04 user nova-compute[74889]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Nov 10 12:06:04 user nova-compute[74889]:         </nova:port>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:port uuid="4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9">
Nov 10 12:06:04 user nova-compute[74889]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 10 12:06:04 user nova-compute[74889]:         </nova:port>
Nov 10 12:06:04 user nova-compute[74889]:         <nova:port uuid="af1150be-d621-4fff-8dc4-c296e3310ba7">
Nov 10 12:06:04 user nova-compute[74889]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 10 12:06:04 user nova-compute[74889]:         </nova:port>
Nov 10 12:06:04 user nova-compute[74889]:       </nova:ports>
Nov 10 12:06:04 user nova-compute[74889]:     </nova:instance>
Nov 10 12:06:04 user nova-compute[74889]:   </metadata>
Nov 10 12:06:04 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:06:04 user nova-compute[74889]:     <system>
Nov 10 12:06:04 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:06:04 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:06:04 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:06:04 user nova-compute[74889]:       <entry name="serial">c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3</entry>
Nov 10 12:06:04 user nova-compute[74889]:       <entry name="uuid">c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3</entry>
Nov 10 12:06:04 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:06:04 user nova-compute[74889]:     </system>
Nov 10 12:06:04 user nova-compute[74889]:   </sysinfo>
Nov 10 12:06:04 user nova-compute[74889]:   <os>
Nov 10 12:06:04 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:06:04 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:06:04 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:06:04 user nova-compute[74889]:   </os>
Nov 10 12:06:04 user nova-compute[74889]:   <features>
Nov 10 12:06:04 user nova-compute[74889]:     <acpi/>
Nov 10 12:06:04 user nova-compute[74889]:     <apic/>
Nov 10 12:06:04 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:06:04 user nova-compute[74889]:   </features>
Nov 10 12:06:04 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:06:04 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:06:04 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:06:04 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:06:04 user nova-compute[74889]:   </clock>
Nov 10 12:06:04 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:06:04 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:06:04 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:06:04 user nova-compute[74889]:   </cpu>
Nov 10 12:06:04 user nova-compute[74889]:   <devices>
Nov 10 12:06:04 user nova-compute[74889]:     <disk type="file" device="cdrom">
Nov 10 12:06:04 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 12:06:04 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3/disk.config"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="hda" bus="ide"/>
Nov 10 12:06:04 user nova-compute[74889]:     </disk>
Nov 10 12:06:04 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:06:04 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:06:04 user nova-compute[74889]:       <source dev="/dev/sdb"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:       <serial>891ad49b-fc2c-4a7d-a076-b163bb8f41d2</serial>
Nov 10 12:06:04 user nova-compute[74889]:     </disk>
Nov 10 12:06:04 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:06:04 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:06:04 user nova-compute[74889]:       <source dev="/dev/sdf"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:       <serial>e59e6264-c07d-4556-b4b5-41b88c204af0</serial>
Nov 10 12:06:04 user nova-compute[74889]:     </disk>
Nov 10 12:06:04 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:06:04 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:06:04 user nova-compute[74889]:       <source dev="/dev/sdg"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="vdc" bus="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:       <serial>095c018d-6937-489d-b155-97dded277605</serial>
Nov 10 12:06:04 user nova-compute[74889]:     </disk>
Nov 10 12:06:04 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:06:04 user nova-compute[74889]:       <mac address="fa:16:3e:97:e4:8d"/>
Nov 10 12:06:04 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="tap27c48730-a1"/>
Nov 10 12:06:04 user nova-compute[74889]:     </interface>
Nov 10 12:06:04 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:06:04 user nova-compute[74889]:       <mac address="fa:16:3e:06:0a:93"/>
Nov 10 12:06:04 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="tapd733429d-fb"/>
Nov 10 12:06:04 user nova-compute[74889]:     </interface>
Nov 10 12:06:04 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:06:04 user nova-compute[74889]:       <mac address="fa:16:3e:cd:87:cb"/>
Nov 10 12:06:04 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="tap1abcaa96-12"/>
Nov 10 12:06:04 user nova-compute[74889]:     </interface>
Nov 10 12:06:04 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:06:04 user nova-compute[74889]:       <mac address="fa:16:3e:0b:d3:08"/>
Nov 10 12:06:04 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="tap34906c48-ea"/>
Nov 10 12:06:04 user nova-compute[74889]:     </interface>
Nov 10 12:06:04 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:06:04 user nova-compute[74889]:       <mac address="fa:16:3e:27:86:d5"/>
Nov 10 12:06:04 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="tapd9cbe8cb-6d"/>
Nov 10 12:06:04 user nova-compute[74889]:     </interface>
Nov 10 12:06:04 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:06:04 user nova-compute[74889]:       <mac address="fa:16:3e:28:f6:07"/>
Nov 10 12:06:04 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="tap4a4e3ef5-97"/>
Nov 10 12:06:04 user nova-compute[74889]:     </interface>
Nov 10 12:06:04 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:06:04 user nova-compute[74889]:       <mac address="fa:16:3e:88:d8:b0"/>
Nov 10 12:06:04 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:06:04 user nova-compute[74889]:       <target dev="tapaf1150be-d6"/>
Nov 10 12:06:04 user nova-compute[74889]:     </interface>
Nov 10 12:06:04 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:06:04 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3/console.log" append="off"/>
Nov 10 12:06:04 user nova-compute[74889]:     </serial>
Nov 10 12:06:04 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:06:04 user nova-compute[74889]:     <video>
Nov 10 12:06:04 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:06:04 user nova-compute[74889]:     </video>
Nov 10 12:06:04 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:06:04 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:06:04 user nova-compute[74889]:     </rng>
Nov 10 12:06:04 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:06:04 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:06:04 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:06:04 user nova-compute[74889]:     </memballoon>
Nov 10 12:06:04 user nova-compute[74889]:   </devices>
Nov 10 12:06:04 user nova-compute[74889]: </domain>
Nov 10 12:06:04 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=27c48730-a168-4ccf-92d4-9e7d6aff5354,network=Network(6b96d1cd-7c4f-4821-bb85-166b161ef722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c48730-a1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=27c48730-a168-4ccf-92d4-9e7d6aff5354,network=Network(6b96d1cd-7c4f-4821-bb85-166b161ef722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c48730-a1') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f868f4ea-3481-5d5c-b680-a6c80ad4482b', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27c48730-a1, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27c48730-a1, col_values=(('qos', UUID('94b598f6-dabe-470b-ba70-2b707fb2e4b1')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27c48730-a1, col_values=(('external_ids', {'iface-id': '27c48730-a168-4ccf-92d4-9e7d6aff5354', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:e4:8d', 'vm-uuid': 'c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: INFO os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=27c48730-a168-4ccf-92d4-9e7d6aff5354,network=Network(6b96d1cd-7c4f-4821-bb85-166b161ef722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c48730-a1')
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:93,bridge_name='br-int',has_traffic_filtering=True,id=d733429d-fba6-47de-b003-a9d5c4346e21,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd733429d-fb') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:93,bridge_name='br-int',has_traffic_filtering=True,id=d733429d-fba6-47de-b003-a9d5c4346e21,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd733429d-fb') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a4b6447-2296-5e66-8dee-c45856a0730d', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd733429d-fb, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd733429d-fb, col_values=(('qos', UUID('7355e887-3c35-454c-97b8-c90ec6869088')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd733429d-fb, col_values=(('external_ids', {'iface-id': 'd733429d-fba6-47de-b003-a9d5c4346e21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:0a:93', 'vm-uuid': 'c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: INFO os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:93,bridge_name='br-int',has_traffic_filtering=True,id=d733429d-fba6-47de-b003-a9d5c4346e21,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd733429d-fb')
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:87:cb,bridge_name='br-int',has_traffic_filtering=True,id=1abcaa96-1230-47d1-b313-c9a1a217747e,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1abcaa96-12') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:87:cb,bridge_name='br-int',has_traffic_filtering=True,id=1abcaa96-1230-47d1-b313-c9a1a217747e,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1abcaa96-12') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd8f7216-d448-5620-996b-6525f9022f04', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1abcaa96-12, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1abcaa96-12, col_values=(('qos', UUID('aaea822d-a478-44fc-abe5-3b9f726a73e8')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1abcaa96-12, col_values=(('external_ids', {'iface-id': '1abcaa96-1230-47d1-b313-c9a1a217747e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:87:cb', 'vm-uuid': 'c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: INFO os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:87:cb,bridge_name='br-int',has_traffic_filtering=True,id=1abcaa96-1230-47d1-b313-c9a1a217747e,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1abcaa96-12')
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d3:08,bridge_name='br-int',has_traffic_filtering=True,id=34906c48-ea17-444c-985b-f9b356e0ccd9,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34906c48-ea') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d3:08,bridge_name='br-int',has_traffic_filtering=True,id=34906c48-ea17-444c-985b-f9b356e0ccd9,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34906c48-ea') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f50a005-919c-58ea-9569-22dc922b4dbd', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34906c48-ea, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34906c48-ea, col_values=(('qos', UUID('0155c074-e25d-4d9d-9ca3-47a013472ccb')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34906c48-ea, col_values=(('external_ids', {'iface-id': '34906c48-ea17-444c-985b-f9b356e0ccd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:d3:08', 'vm-uuid': 'c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: INFO os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d3:08,bridge_name='br-int',has_traffic_filtering=True,id=34906c48-ea17-444c-985b-f9b356e0ccd9,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34906c48-ea')
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=d9cbe8cb-6d2c-4288-8582-4b6b240f97d1,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cbe8cb-6d') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=d9cbe8cb-6d2c-4288-8582-4b6b240f97d1,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cbe8cb-6d') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54eba841-5ab4-5fe1-a07d-d72be352b0a6', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9cbe8cb-6d, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9cbe8cb-6d, col_values=(('qos', UUID('8ef07587-63d5-4212-ae0b-b411c5277784')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9cbe8cb-6d, col_values=(('external_ids', {'iface-id': 'd9cbe8cb-6d2c-4288-8582-4b6b240f97d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:86:d5', 'vm-uuid': 'c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: INFO os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=d9cbe8cb-6d2c-4288-8582-4b6b240f97d1,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cbe8cb-6d')
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4e3ef5-97') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4e3ef5-97') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34ea272c-74a8-5d5f-a58d-c5a5a678f263', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a4e3ef5-97, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a4e3ef5-97, col_values=(('qos', UUID('d023a0f3-00fe-450f-81ec-8ccf620b6656')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a4e3ef5-97, col_values=(('external_ids', {'iface-id': '4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:f6:07', 'vm-uuid': 'c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: INFO os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4e3ef5-97')
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d8:b0,bridge_name='br-int',has_traffic_filtering=True,id=af1150be-d621-4fff-8dc4-c296e3310ba7,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1150be-d6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d8:b0,bridge_name='br-int',has_traffic_filtering=True,id=af1150be-d621-4fff-8dc4-c296e3310ba7,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1150be-d6') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '947b4b74-2b60-5ae2-8e74-415f12a240ca', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf1150be-d6, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf1150be-d6, col_values=(('qos', UUID('b31be0e8-2e25-4c10-bc04-83b8623aac2c')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf1150be-d6, col_values=(('external_ids', {'iface-id': 'af1150be-d621-4fff-8dc4-c296e3310ba7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:d8:b0', 'vm-uuid': 'c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:05 user nova-compute[74889]: INFO os_vif [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d8:b0,bridge_name='br-int',has_traffic_filtering=True,id=af1150be-d621-4fff-8dc4-c296e3310ba7,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1150be-d6')
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] No BDM found with device name hda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] No VIF found with MAC fa:16:3e:97:e4:8d, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] No VIF found with MAC fa:16:3e:27:86:d5, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:06:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Using config drive
Nov 10 12:06:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Creating config drive at /opt/stack/data/nova/instances/c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3/disk.config
Nov 10 12:06:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2qu2wakq {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2qu2wakq" returned: 0 in 0.064s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-dbd7d260-e277-4f92-8320-437378479ee5 req-96c944cc-7e9d-431a-b3a4-7f0d824d6b3c service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-dbd7d260-e277-4f92-8320-437378479ee5 req-96c944cc-7e9d-431a-b3a4-7f0d824d6b3c service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-dbd7d260-e277-4f92-8320-437378479ee5 req-96c944cc-7e9d-431a-b3a4-7f0d824d6b3c service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-dbd7d260-e277-4f92-8320-437378479ee5 req-96c944cc-7e9d-431a-b3a4-7f0d824d6b3c service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-dbd7d260-e277-4f92-8320-437378479ee5 req-96c944cc-7e9d-431a-b3a4-7f0d824d6b3c service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:07 user nova-compute[74889]: WARNING nova.compute.manager [req-dbd7d260-e277-4f92-8320-437378479ee5 req-96c944cc-7e9d-431a-b3a4-7f0d824d6b3c service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 for instance with vm_state building and task_state spawning.
Nov 10 12:06:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-a8a280e9-1e82-48b6-8ad9-8af9d8cd544a req-98798614-ddb5-4c05-b845-acae293e5768 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a8a280e9-1e82-48b6-8ad9-8af9d8cd544a req-98798614-ddb5-4c05-b845-acae293e5768 service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a8a280e9-1e82-48b6-8ad9-8af9d8cd544a req-98798614-ddb5-4c05-b845-acae293e5768 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a8a280e9-1e82-48b6-8ad9-8af9d8cd544a req-98798614-ddb5-4c05-b845-acae293e5768 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-a8a280e9-1e82-48b6-8ad9-8af9d8cd544a req-98798614-ddb5-4c05-b845-acae293e5768 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:08 user nova-compute[74889]: WARNING nova.compute.manager [req-a8a280e9-1e82-48b6-8ad9-8af9d8cd544a req-98798614-ddb5-4c05-b845-acae293e5768 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-d733429d-fba6-47de-b003-a9d5c4346e21 for instance with vm_state building and task_state spawning.
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-c0b52c24-f0b9-44ca-a67a-f6cb44746b22 req-aabf0c55-2b0a-4515-bdb8-79bb31f189bb service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c0b52c24-f0b9-44ca-a67a-f6cb44746b22 req-aabf0c55-2b0a-4515-bdb8-79bb31f189bb service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c0b52c24-f0b9-44ca-a67a-f6cb44746b22 req-aabf0c55-2b0a-4515-bdb8-79bb31f189bb service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c0b52c24-f0b9-44ca-a67a-f6cb44746b22 req-aabf0c55-2b0a-4515-bdb8-79bb31f189bb service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-c0b52c24-f0b9-44ca-a67a-f6cb44746b22 req-aabf0c55-2b0a-4515-bdb8-79bb31f189bb service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:08 user nova-compute[74889]: WARNING nova.compute.manager [req-c0b52c24-f0b9-44ca-a67a-f6cb44746b22 req-aabf0c55-2b0a-4515-bdb8-79bb31f189bb service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-1abcaa96-1230-47d1-b313-c9a1a217747e for instance with vm_state building and task_state spawning.
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:10 user nova-compute[74889]: WARNING nova.compute.manager [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-d733429d-fba6-47de-b003-a9d5c4346e21 for instance with vm_state building and task_state spawning.
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:10 user nova-compute[74889]: WARNING nova.compute.manager [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 for instance with vm_state building and task_state spawning.
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:10 user nova-compute[74889]: WARNING nova.compute.manager [req-5e1e450b-0882-45bf-b43f-58c29202ecc1 req-c32bc621-cf85-4ab8-b95c-b71c035cffc3 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 for instance with vm_state building and task_state spawning.
Nov 10 12:06:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:10 user nova-compute[74889]: WARNING nova.compute.manager [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-1abcaa96-1230-47d1-b313-c9a1a217747e for instance with vm_state building and task_state spawning.
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:10 user nova-compute[74889]: WARNING nova.compute.manager [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-34906c48-ea17-444c-985b-f9b356e0ccd9 for instance with vm_state building and task_state spawning.
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:10 user nova-compute[74889]: WARNING nova.compute.manager [req-d89d9e4b-f463-45ac-a45b-ffc17819fd88 req-fe6b666f-e337-4cb5-ae17-814ca42e4b9a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-34906c48-ea17-444c-985b-f9b356e0ccd9 for instance with vm_state building and task_state spawning.
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:10 user nova-compute[74889]: WARNING nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 for instance with vm_state building and task_state spawning.
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:10 user nova-compute[74889]: WARNING nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 for instance with vm_state building and task_state spawning.
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:10 user nova-compute[74889]: WARNING nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 for instance with vm_state building and task_state spawning.
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:10 user nova-compute[74889]: WARNING nova.compute.manager [req-4cd4e8d1-4b44-41b4-a96a-1fb03d5ca68e req-44337e18-00de-40ee-8d65-2b7b9b07e2c6 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-af1150be-d621-4fff-8dc4-c296e3310ba7 for instance with vm_state building and task_state spawning.
Nov 10 12:06:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:11 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b11fa594-7afe-4454-bbc2-e68a3564500e is timed out.
Nov 10 12:06:11 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully detached device vdc from instance b11fa594-7afe-4454-bbc2-e68a3564500e from the live domain config.
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvsfFbYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:06:11 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fb4bb3-0565-4780-8aa3-4e92992ba951]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:06:11 user nova-compute[74889]: No targets found.
Nov 10 12:06:11 user nova-compute[74889]: iSNS:
Nov 10 12:06:11 user nova-compute[74889]: No targets found.
Nov 10 12:06:11 user nova-compute[74889]: STATIC:
Nov 10 12:06:11 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2
Nov 10 12:06:11 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:06:11 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:06:11 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:06:11 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:06:11 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:06:11 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4
Nov 10 12:06:11 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:06:11 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:06:11 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605
Nov 10 12:06:11 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:06:11 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:06:11 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:06:11 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:06:11 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:06:11 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0
Nov 10 12:06:11 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:06:11 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:06:11 user nova-compute[74889]: FIRMWARE:
Nov 10 12:06:11 user nova-compute[74889]: No targets found.
Nov 10 12:06:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:06:11 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:06:11 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fe39a2-faca-467c-aad1-8c5d6fceb8a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e555d1-fb9a-4f3e-be7d-c370298fe9f4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:11 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:11 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:11 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:11 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:11 user nova-compute[74889]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)
Nov 10 12:06:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:11 user nova-compute[74889]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 (non-flash)
Nov 10 12:06:11 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:11 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:11 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:11 user nova-compute[74889]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)
Nov 10 12:06:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a01aeb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[da150d10-0deb-4e97-94a6-3b84261545a1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cb033f-d39b-43e4-b54b-3a5409094447]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[da284ab1-976f-48e7-8fa5-9544fe89efff]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:06:11 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance spawned successfully.
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dd266b-c29f-4106-8d0e-f2fa8008e7ed]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9456284f-a299-4bd3-a11e-b6efb4dcd1c1]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1053b0-204d-4b84-a3e4-4325bc7b5496]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4, portal: 172.16.0.220,3260]
Nov 10 12:06:11 user nova-compute[74889]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4, portal: 172.16.0.220,3260] successful.
Nov 10 12:06:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:11 user nova-compute[74889]: INFO nova.compute.manager [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Took 11.29 seconds to spawn the instance on the hypervisor.
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6b443f5-f75b-4fe6-a04e-51a62b6bb4e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd30f1e5-e140-413c-972b-25465a74a74f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] <== disconnect_volume: return (331ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:06:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:06:12 user nova-compute[74889]: INFO nova.compute.manager [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Took 95.21 seconds to build instance.
Nov 10 12:06:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6b679a3e-3490-4128-b187-f50b9298ac19 tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 95.335s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-163d1152-401d-4e56-adc6-02f39f6016f9 req-6b59287c-9714-41fb-be48-d8d8a70836b1 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-163d1152-401d-4e56-adc6-02f39f6016f9 req-6b59287c-9714-41fb-be48-d8d8a70836b1 service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-163d1152-401d-4e56-adc6-02f39f6016f9 req-6b59287c-9714-41fb-be48-d8d8a70836b1 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-163d1152-401d-4e56-adc6-02f39f6016f9 req-6b59287c-9714-41fb-be48-d8d8a70836b1 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-163d1152-401d-4e56-adc6-02f39f6016f9 req-6b59287c-9714-41fb-be48-d8d8a70836b1 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:12 user nova-compute[74889]: WARNING nova.compute.manager [req-163d1152-401d-4e56-adc6-02f39f6016f9 req-6b59287c-9714-41fb-be48-d8d8a70836b1 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-af1150be-d621-4fff-8dc4-c296e3310ba7 for instance with vm_state active and task_state None.
Nov 10 12:06:12 user nova-compute[74889]: DEBUG nova.objects.instance [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'flavor' on Instance uuid b11fa594-7afe-4454-bbc2-e68a3564500e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:06:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-994b6438-500e-4d42-af96-81b71c2869db tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.073s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:14 user nova-compute[74889]: INFO nova.compute.manager [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Terminating instance
Nov 10 12:06:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-ba8bec91-3d78-47d6-814a-abb28965ee49 req-eef84ac7-3d9e-4464-b547-7026f5c2f36e service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-vif-unplugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ba8bec91-3d78-47d6-814a-abb28965ee49 req-eef84ac7-3d9e-4464-b547-7026f5c2f36e service nova] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ba8bec91-3d78-47d6-814a-abb28965ee49 req-eef84ac7-3d9e-4464-b547-7026f5c2f36e service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ba8bec91-3d78-47d6-814a-abb28965ee49 req-eef84ac7-3d9e-4464-b547-7026f5c2f36e service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-ba8bec91-3d78-47d6-814a-abb28965ee49 req-eef84ac7-3d9e-4464-b547-7026f5c2f36e service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] No waiting events found dispatching network-vif-unplugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-ba8bec91-3d78-47d6-814a-abb28965ee49 req-eef84ac7-3d9e-4464-b547-7026f5c2f36e service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-vif-unplugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Instance destroyed successfully.
Nov 10 12:06:15 user nova-compute[74889]: DEBUG nova.objects.instance [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lazy-loading 'resources' on Instance uuid b11fa594-7afe-4454-bbc2-e68a3564500e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:02:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-547757369',display_name='tempest-AttachVolumeTestJSON-server-547757369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-547757369',id=23,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXxmHL5QVe+PvfGtjBG9i2g71uxXB9DHwvOoAdzQXj/RxzB4fgUBQNm/qChjoqMXRb2A2vbJC3MSzJ3tSbPAIUV0SZ6MWHE4m6rhUWWCNp+g3dXt/+RxoxZ6XKsfzokhg==',key_name='tempest-keypair-1845325555',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:02:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeabeb4c529647f296feb83801c04f34',ramdisk_id='',reservation_id='r-3z41f0cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1611590837',owner_user_name='tempest-AttachVolumeTestJSON-1611590837-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:02:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9dd24986fbd2446dbb8f5fbc7edb1757',uuid=b11fa594-7afe-4454-bbc2-e68a3564500e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converting VIF {"id": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "address": "fa:16:3e:b1:11:4a", "network": {"id": "bfedbd20-596e-4c75-b53f-567dbc9d95cf", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1051593799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeabeb4c529647f296feb83801c04f34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb9d41-aa", "ovs_interfaceid": "4ceb9d41-aad6-4ed3-8b12-50413fabe32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=4ceb9d41-aad6-4ed3-8b12-50413fabe32d,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb9d41-aa') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG os_vif [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=4ceb9d41-aad6-4ed3-8b12-50413fabe32d,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb9d41-aa') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ceb9d41-aa, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20eb081c-e277-4b71-aeb0-4a0caaf8a33e) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: INFO os_vif [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:11:4a,bridge_name='br-int',has_traffic_filtering=True,id=4ceb9d41-aad6-4ed3-8b12-50413fabe32d,network=Network(bfedbd20-596e-4c75-b53f-567dbc9d95cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb9d41-aa')
Nov 10 12:06:15 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Deleting instance files /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e_del
Nov 10 12:06:15 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Deletion of /opt/stack/data/nova/instances/b11fa594-7afe-4454-bbc2-e68a3564500e_del complete
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: INFO nova.compute.manager [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 10 12:06:15 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqiynLHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:06:16 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:06:16 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:06:16 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ac6cd8-2e4f-4af3-8f61-f900206d509f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:06:16 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-773d45f6-9b97-4bc4-8f80-456770ec84e9 req-f21e307e-3a01-4ca6-a2d5-c26d97ca8a18 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-vif-deleted-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:16 user nova-compute[74889]: INFO nova.compute.manager [req-773d45f6-9b97-4bc4-8f80-456770ec84e9 req-f21e307e-3a01-4ca6-a2d5-c26d97ca8a18 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Neutron deleted interface 4ceb9d41-aad6-4ed3-8b12-50413fabe32d; detaching it from the instance and deleting it from the info cache
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.network.neutron [req-773d45f6-9b97-4bc4-8f80-456770ec84e9 req-f21e307e-3a01-4ca6-a2d5-c26d97ca8a18 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c722cf0-78ad-414d-ba36-b705a4b077ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1] added
Nov 10 12:06:16 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:16 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Took 0.89 seconds to deallocate network for instance.
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-773d45f6-9b97-4bc4-8f80-456770ec84e9 req-f21e307e-3a01-4ca6-a2d5-c26d97ca8a18 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Detach interface failed, port_id=4ceb9d41-aad6-4ed3-8b12-50413fabe32d, reason: Instance b11fa594-7afe-4454-bbc2-e68a3564500e could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4888a563-c98e-40b0-bfc4-47c5a29b7268]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74310ed-9932-407f-afbc-3949417ac5b3]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqiynLHa {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mqiynLHa" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75730e0-69d1-47a9-bfc2-2289ae723596]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mqiynLHa'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[857f9f00-7b83-4947-b7ff-ddff78d1241d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[82668ff2-ab73-4922-b238-ea7cf4bf7ef0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2610a8dd-1dd8-455e-aae6-cf27398e29c2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1, portal: 172.16.0.220,3260]
Nov 10 12:06:16 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1, portal: 172.16.0.220,3260] successful.
Nov 10 12:06:16 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d9aa61-bcef-4486-9f91-0f316259b44e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[032a8a46-2ca8-413d-beae-e47b762832b2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:06:16 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5c9fb0-982f-4970-a3ba-c88a0552d16f]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqiynLHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] No waiting events found dispatching network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:16 user nova-compute[74889]: WARNING nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received unexpected event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d for instance with vm_state deleted and task_state None.
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] No waiting events found dispatching network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:16 user nova-compute[74889]: WARNING nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received unexpected event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d for instance with vm_state deleted and task_state None.
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] No waiting events found dispatching network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:16 user nova-compute[74889]: WARNING nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received unexpected event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d for instance with vm_state deleted and task_state None.
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-vif-unplugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] No waiting events found dispatching network-vif-unplugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:16 user nova-compute[74889]: WARNING nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received unexpected event network-vif-unplugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d for instance with vm_state deleted and task_state None.
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Acquiring lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] No waiting events found dispatching network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:16 user nova-compute[74889]: WARNING nova.compute.manager [req-e4913666-fedb-461d-83b4-8b1325b29454 req-65cb2e82-ba19-42c7-867d-9a15d0218068 service nova] [instance: b11fa594-7afe-4454-bbc2-e68a3564500e] Received unexpected event network-vif-plugged-4ceb9d41-aad6-4ed3-8b12-50413fabe32d for instance with vm_state deleted and task_state None.
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:16 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Deleted allocations for instance b11fa594-7afe-4454-bbc2-e68a3564500e
Nov 10 12:06:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bf963633-fe99-481c-8026-e2be5f013e2c tempest-AttachVolumeTestJSON-1611590837 tempest-AttachVolumeTestJSON-1611590837-project-member] Lock "b11fa594-7afe-4454-bbc2-e68a3564500e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.518s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:06:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '26438323261343038', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:06:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438323261343038', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:06:17 user nova-compute[74889]: DEBUG nova.objects.instance [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'flavor' on Instance uuid a37438e5-4f27-439c-a9f9-c3f9aa396d94 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:06:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:06:17 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:06:17 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:06:17 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:06:17 user nova-compute[74889]:   <serial>fcfa18dd-feb7-4f7e-a414-5b98a470dab1</serial>
Nov 10 12:06:17 user nova-compute[74889]: </disk>
Nov 10 12:06:17 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:06:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:06:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:06:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] No VIF found with MAC fa:16:3e:1f:84:ff, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:06:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a1c54bf5-5391-4328-a3ca-c53ac7f27e85 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.151s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-bea95b22-23c8-4f07-99f1-d56c0988b6c5 req-dd7036e5-6c1d-4fc4-a67b-8d4d900dc913 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-changed-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-bea95b22-23c8-4f07-99f1-d56c0988b6c5 req-dd7036e5-6c1d-4fc4-a67b-8d4d900dc913 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Refreshing instance network info cache due to event network-changed-4a76e957-2ed4-480f-8493-aef332d05f7c. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:06:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bea95b22-23c8-4f07-99f1-d56c0988b6c5 req-dd7036e5-6c1d-4fc4-a67b-8d4d900dc913 service nova] Acquiring lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:06:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bea95b22-23c8-4f07-99f1-d56c0988b6c5 req-dd7036e5-6c1d-4fc4-a67b-8d4d900dc913 service nova] Acquired lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:06:20 user nova-compute[74889]: DEBUG nova.network.neutron [req-bea95b22-23c8-4f07-99f1-d56c0988b6c5 req-dd7036e5-6c1d-4fc4-a67b-8d4d900dc913 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Refreshing network info cache for port 4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:06:21 user nova-compute[74889]: DEBUG nova.network.neutron [req-bea95b22-23c8-4f07-99f1-d56c0988b6c5 req-dd7036e5-6c1d-4fc4-a67b-8d4d900dc913 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updated VIF entry in instance network info cache for port 4a76e957-2ed4-480f-8493-aef332d05f7c. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:06:21 user nova-compute[74889]: DEBUG nova.network.neutron [req-bea95b22-23c8-4f07-99f1-d56c0988b6c5 req-dd7036e5-6c1d-4fc4-a67b-8d4d900dc913 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updating instance_info_cache with network_info: [{"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:06:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bea95b22-23c8-4f07-99f1-d56c0988b6c5 req-dd7036e5-6c1d-4fc4-a67b-8d4d900dc913 service nova] Releasing lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-83736683-27cf-4b85-ae9e-ab6287925e8b req-c17356f4-b5cf-409d-be1a-6e12f54666c3 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-changed-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-83736683-27cf-4b85-ae9e-ab6287925e8b req-c17356f4-b5cf-409d-be1a-6e12f54666c3 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Refreshing instance network info cache due to event network-changed-4a76e957-2ed4-480f-8493-aef332d05f7c. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-83736683-27cf-4b85-ae9e-ab6287925e8b req-c17356f4-b5cf-409d-be1a-6e12f54666c3 service nova] Acquiring lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-83736683-27cf-4b85-ae9e-ab6287925e8b req-c17356f4-b5cf-409d-be1a-6e12f54666c3 service nova] Acquired lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG nova.network.neutron [req-83736683-27cf-4b85-ae9e-ab6287925e8b req-c17356f4-b5cf-409d-be1a-6e12f54666c3 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Refreshing network info cache for port 4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG nova.network.neutron [req-83736683-27cf-4b85-ae9e-ab6287925e8b req-c17356f4-b5cf-409d-be1a-6e12f54666c3 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updated VIF entry in instance network info cache for port 4a76e957-2ed4-480f-8493-aef332d05f7c. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG nova.network.neutron [req-83736683-27cf-4b85-ae9e-ab6287925e8b req-c17356f4-b5cf-409d-be1a-6e12f54666c3 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updating instance_info_cache with network_info: [{"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-83736683-27cf-4b85-ae9e-ab6287925e8b req-c17356f4-b5cf-409d-be1a-6e12f54666c3 service nova] Releasing lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.004s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:23 user nova-compute[74889]: INFO nova.compute.manager [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Rebooting instance
Nov 10 12:06:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquired lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:06:23 user nova-compute[74889]: DEBUG nova.network.neutron [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:06:24 user nova-compute[74889]: DEBUG nova.network.neutron [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updating instance_info_cache with network_info: [{"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:06:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Releasing lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:06:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:06:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-aa191c2b-4a38-467a-a943-bfb66df5bba8 req-e60102af-0eb2-4f99-83a8-2c0e0ebebee9 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-vif-unplugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-aa191c2b-4a38-467a-a943-bfb66df5bba8 req-e60102af-0eb2-4f99-83a8-2c0e0ebebee9 service nova] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-aa191c2b-4a38-467a-a943-bfb66df5bba8 req-e60102af-0eb2-4f99-83a8-2c0e0ebebee9 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-aa191c2b-4a38-467a-a943-bfb66df5bba8 req-e60102af-0eb2-4f99-83a8-2c0e0ebebee9 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-aa191c2b-4a38-467a-a943-bfb66df5bba8 req-e60102af-0eb2-4f99-83a8-2c0e0ebebee9 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] No waiting events found dispatching network-vif-unplugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:26 user nova-compute[74889]: WARNING nova.compute.manager [req-aa191c2b-4a38-467a-a943-bfb66df5bba8 req-e60102af-0eb2-4f99-83a8-2c0e0ebebee9 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received unexpected event network-vif-unplugged-4a76e957-2ed4-480f-8493-aef332d05f7c for instance with vm_state active and task_state reboot_started.
Nov 10 12:06:27 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Instance shutdown successfully.
Nov 10 12:06:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] No waiting events found dispatching network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:28 user nova-compute[74889]: WARNING nova.compute.manager [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received unexpected event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c for instance with vm_state active and task_state reboot_started.
Nov 10 12:06:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] No waiting events found dispatching network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:28 user nova-compute[74889]: WARNING nova.compute.manager [req-ecce04fe-c5be-415f-9839-0738fce78f56 req-24e5bb99-6d67-4a7e-bb48-b3362f80bb89 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received unexpected event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c for instance with vm_state active and task_state reboot_started.
Nov 10 12:06:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:30 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Instance running successfully.
Nov 10 12:06:30 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Instance soft rebooted successfully.
Nov 10 12:06:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5b9c5a18-2ef8-46c2-af69-2fbf735135b5 tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.378s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-bca7b7ee-a726-47b8-8272-ff4cdac164a1 req-3173dcf4-346d-44d4-892b-7dac892b4356 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bca7b7ee-a726-47b8-8272-ff4cdac164a1 req-3173dcf4-346d-44d4-892b-7dac892b4356 service nova] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bca7b7ee-a726-47b8-8272-ff4cdac164a1 req-3173dcf4-346d-44d4-892b-7dac892b4356 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bca7b7ee-a726-47b8-8272-ff4cdac164a1 req-3173dcf4-346d-44d4-892b-7dac892b4356 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-bca7b7ee-a726-47b8-8272-ff4cdac164a1 req-3173dcf4-346d-44d4-892b-7dac892b4356 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] No waiting events found dispatching network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:06:31 user nova-compute[74889]: WARNING nova.compute.manager [req-bca7b7ee-a726-47b8-8272-ff4cdac164a1 req-3173dcf4-346d-44d4-892b-7dac892b4356 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received unexpected event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c for instance with vm_state active and task_state None.
Nov 10 12:06:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Going to confirm migration 1 {{(pid=74889) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquired lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:06:31 user nova-compute[74889]: DEBUG nova.objects.instance [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'info_cache' on Instance uuid 1aaa9255-2adb-4f1e-8952-af99a86fa99d {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:06:32 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating instance_info_cache with network_info: [{"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:06:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Releasing lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:06:32 user nova-compute[74889]: DEBUG nova.objects.instance [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'migration_context' on Instance uuid 1aaa9255-2adb-4f1e-8952-af99a86fa99d {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:06:32 user nova-compute[74889]: DEBUG nova.objects.base [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Object Instance<1aaa9255-2adb-4f1e-8952-af99a86fa99d> lazy-loaded attributes: info_cache,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:06:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:32 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:06:32 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:06:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.419s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:33 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Deleted allocation for migration db62d8cd-0626-4682-9208-5c3b6302ff89
Nov 10 12:06:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c56883e1-7989-457c-8567-9d30b7ca6f66 tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.894s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:42 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:43 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:43 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:06:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:06:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:06:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:06:48 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:06:48 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7414MB free_disk=25.386505126953125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 22718082-4c44-4384-8692-c216bb1a14e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 516ca546-b343-4d97-943d-05b975b57f79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 1aaa9255-2adb-4f1e-8952-af99a86fa99d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance c12c5975-867c-46fb-897a-1adc16ab47b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 14b9e652-8956-4e69-96e1-0677c49381f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:06:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:06:49 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:06:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:06:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:06:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:06:49 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:06:49 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid 19d4137a-5cdf-42d1-8846-35813d6360f6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:06:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:49 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updating instance_info_cache with network_info: [{"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:06:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-19d4137a-5cdf-42d1-8846-35813d6360f6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:06:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:06:50 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 12:06:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 12:06:50 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 12:06:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:50 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:50 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:52 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:06:55 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:06:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:06:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-ab1e2fc2-f8fb-41bc-8138-62838b9f9316 req-6d3c4941-c19a-4ea4-99e8-fa147e9955db service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received event network-changed-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-ab1e2fc2-f8fb-41bc-8138-62838b9f9316 req-6d3c4941-c19a-4ea4-99e8-fa147e9955db service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Refreshing instance network info cache due to event network-changed-4637bfab-a1e0-4684-a3e2-f140baf0b1f0. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ab1e2fc2-f8fb-41bc-8138-62838b9f9316 req-6d3c4941-c19a-4ea4-99e8-fa147e9955db service nova] Acquiring lock "refresh_cache-c12c5975-867c-46fb-897a-1adc16ab47b3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ab1e2fc2-f8fb-41bc-8138-62838b9f9316 req-6d3c4941-c19a-4ea4-99e8-fa147e9955db service nova] Acquired lock "refresh_cache-c12c5975-867c-46fb-897a-1adc16ab47b3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-ab1e2fc2-f8fb-41bc-8138-62838b9f9316 req-6d3c4941-c19a-4ea4-99e8-fa147e9955db service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Refreshing network info cache for port 4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG nova.objects.instance [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lazy-loading 'flavor' on Instance uuid c12c5975-867c-46fb-897a-1adc16ab47b3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:07:07 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Ignoring supplied device name: /dev/vdb
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.116s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:07 user nova-compute[74889]: INFO nova.compute.manager [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Attaching volume 31233c75-f639-40c1-970a-2ee90d94c6b5 to /dev/vdb
Nov 10 12:07:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-70212180-062b-4cac-80ed-3418a2d00f74 req-8b81f409-5ad0-47e7-bc4e-01c4d0c0cb62 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-changed-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-70212180-062b-4cac-80ed-3418a2d00f74 req-8b81f409-5ad0-47e7-bc4e-01c4d0c0cb62 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Refreshing instance network info cache due to event network-changed-999a321c-2987-4a20-8414-da97331a6a9d. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-70212180-062b-4cac-80ed-3418a2d00f74 req-8b81f409-5ad0-47e7-bc4e-01c4d0c0cb62 service nova] Acquiring lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-70212180-062b-4cac-80ed-3418a2d00f74 req-8b81f409-5ad0-47e7-bc4e-01c4d0c0cb62 service nova] Acquired lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-70212180-062b-4cac-80ed-3418a2d00f74 req-8b81f409-5ad0-47e7-bc4e-01c4d0c0cb62 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Refreshing network info cache for port 999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG os_brick.utils [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-ab1e2fc2-f8fb-41bc-8138-62838b9f9316 req-6d3c4941-c19a-4ea4-99e8-fa147e9955db service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Updated VIF entry in instance network info cache for port 4637bfab-a1e0-4684-a3e2-f140baf0b1f0. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-ab1e2fc2-f8fb-41bc-8138-62838b9f9316 req-6d3c4941-c19a-4ea4-99e8-fa147e9955db service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Updating instance_info_cache with network_info: [{"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[64351ece-0bdf-4bb9-a1c6-c0c24ee86d09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ab1e2fc2-f8fb-41bc-8138-62838b9f9316 req-6d3c4941-c19a-4ea4-99e8-fa147e9955db service nova] Releasing lock "refresh_cache-c12c5975-867c-46fb-897a-1adc16ab47b3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[11be20df-43c9-43e1-a2cf-ace2f7b73231]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcc1dc2-ca5e-4b0a-a446-22f4f5eb5d2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab47da8-38c5-4d1e-bfae-9829e96bb229]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:07:07 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:07:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[362dad16-6b9b-4b59-be13-3e8aa26570e4]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG os_brick.utils [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:07:07 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Updating existing volume attachment record: 53876955-51cf-4aa7-be2b-1dfc4297cd33 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:07:08 user nova-compute[74889]: DEBUG nova.network.neutron [req-70212180-062b-4cac-80ed-3418a2d00f74 req-8b81f409-5ad0-47e7-bc4e-01c4d0c0cb62 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Updated VIF entry in instance network info cache for port 999a321c-2987-4a20-8414-da97331a6a9d. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:07:08 user nova-compute[74889]: DEBUG nova.network.neutron [req-70212180-062b-4cac-80ed-3418a2d00f74 req-8b81f409-5ad0-47e7-bc4e-01c4d0c0cb62 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Updating instance_info_cache with network_info: [{"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-70212180-062b-4cac-80ed-3418a2d00f74 req-8b81f409-5ad0-47e7-bc4e-01c4d0c0cb62 service nova] Releasing lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:07:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-ffa99b90-50c1-4bab-867f-4ed6931037b6 req-0d2fc762-d024-41f1-b534-d53db043bc3d service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received event network-changed-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-ffa99b90-50c1-4bab-867f-4ed6931037b6 req-0d2fc762-d024-41f1-b534-d53db043bc3d service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Refreshing instance network info cache due to event network-changed-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:07:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ffa99b90-50c1-4bab-867f-4ed6931037b6 req-0d2fc762-d024-41f1-b534-d53db043bc3d service nova] Acquiring lock "refresh_cache-14b9e652-8956-4e69-96e1-0677c49381f1" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:07:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ffa99b90-50c1-4bab-867f-4ed6931037b6 req-0d2fc762-d024-41f1-b534-d53db043bc3d service nova] Acquired lock "refresh_cache-14b9e652-8956-4e69-96e1-0677c49381f1" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:07:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-ffa99b90-50c1-4bab-867f-4ed6931037b6 req-0d2fc762-d024-41f1-b534-d53db043bc3d service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Refreshing network info cache for port 9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:07:16 user nova-compute[74889]: DEBUG nova.network.neutron [req-ffa99b90-50c1-4bab-867f-4ed6931037b6 req-0d2fc762-d024-41f1-b534-d53db043bc3d service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Updated VIF entry in instance network info cache for port 9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:07:16 user nova-compute[74889]: DEBUG nova.network.neutron [req-ffa99b90-50c1-4bab-867f-4ed6931037b6 req-0d2fc762-d024-41f1-b534-d53db043bc3d service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Updating instance_info_cache with network_info: [{"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ffa99b90-50c1-4bab-867f-4ed6931037b6 req-0d2fc762-d024-41f1-b534-d53db043bc3d service nova] Releasing lock "refresh_cache-14b9e652-8956-4e69-96e1-0677c49381f1" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:07:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-44049446-0a6f-496f-a72f-3823a891664b req-48914b29-239f-4aa4-a44a-f78a1ec3e1b4 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-changed-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-44049446-0a6f-496f-a72f-3823a891664b req-48914b29-239f-4aa4-a44a-f78a1ec3e1b4 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing instance network info cache due to event network-changed-27c48730-a168-4ccf-92d4-9e7d6aff5354. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:07:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-44049446-0a6f-496f-a72f-3823a891664b req-48914b29-239f-4aa4-a44a-f78a1ec3e1b4 service nova] Acquiring lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:07:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-44049446-0a6f-496f-a72f-3823a891664b req-48914b29-239f-4aa4-a44a-f78a1ec3e1b4 service nova] Acquired lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:07:18 user nova-compute[74889]: DEBUG nova.network.neutron [req-44049446-0a6f-496f-a72f-3823a891664b req-48914b29-239f-4aa4-a44a-f78a1ec3e1b4 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Refreshing network info cache for port 27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:07:18 user nova-compute[74889]: DEBUG nova.network.neutron [req-44049446-0a6f-496f-a72f-3823a891664b req-48914b29-239f-4aa4-a44a-f78a1ec3e1b4 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updated VIF entry in instance network info cache for port 27c48730-a168-4ccf-92d4-9e7d6aff5354. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:07:18 user nova-compute[74889]: DEBUG nova.network.neutron [req-44049446-0a6f-496f-a72f-3823a891664b req-48914b29-239f-4aa4-a44a-f78a1ec3e1b4 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [{"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-44049446-0a6f-496f-a72f-3823a891664b req-48914b29-239f-4aa4-a44a-f78a1ec3e1b4 service nova] Releasing lock "refresh_cache-c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:07:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "516ca546-b343-4d97-943d-05b975b57f79" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "516ca546-b343-4d97-943d-05b975b57f79" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:19 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lazy-loading 'flavor' on Instance uuid 516ca546-b343-4d97-943d-05b975b57f79 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:07:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "516ca546-b343-4d97-943d-05b975b57f79" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "516ca546-b343-4d97-943d-05b975b57f79" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "516ca546-b343-4d97-943d-05b975b57f79" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:20 user nova-compute[74889]: INFO nova.compute.manager [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Attaching volume f76334cd-059e-440d-8fe3-5749c96b3d45 to /dev/vdb
Nov 10 12:07:20 user nova-compute[74889]: DEBUG os_brick.utils [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[940e0d6a-0308-4321-bbcf-ce793b5a04cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b30b138-4f45-49ba-a92a-c074c544ebc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56b46d9-f066-482c-a934-9a9d091fd478]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f1528f-ef9b-4b36-a9dc-2c1675f51270]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:07:20 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db5fa87-d152-4862-9916-3a2be6027829]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG os_brick.utils [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Updating existing volume attachment record: 86d2199e-d394-4e15-9e3c-8ee78c36d7ae {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:20 user nova-compute[74889]: INFO nova.compute.manager [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Terminating instance
Nov 10 12:07:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-a87a625e-5fca-4ea2-bb77-c8c12556c2de req-685e16b3-16c2-4cbe-aa2b-68fb22aa5bbb service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a87a625e-5fca-4ea2-bb77-c8c12556c2de req-685e16b3-16c2-4cbe-aa2b-68fb22aa5bbb service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a87a625e-5fca-4ea2-bb77-c8c12556c2de req-685e16b3-16c2-4cbe-aa2b-68fb22aa5bbb service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a87a625e-5fca-4ea2-bb77-c8c12556c2de req-685e16b3-16c2-4cbe-aa2b-68fb22aa5bbb service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-a87a625e-5fca-4ea2-bb77-c8c12556c2de req-685e16b3-16c2-4cbe-aa2b-68fb22aa5bbb service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-unplugged-1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-a87a625e-5fca-4ea2-bb77-c8c12556c2de req-685e16b3-16c2-4cbe-aa2b-68fb22aa5bbb service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-1abcaa96-1230-47d1-b313-c9a1a217747e for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-e610cabc-8216-4bd6-a940-59654a69c2c6 req-8c2f10df-d13c-4296-a427-f31cd2d4e0d8 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e610cabc-8216-4bd6-a940-59654a69c2c6 req-8c2f10df-d13c-4296-a427-f31cd2d4e0d8 service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e610cabc-8216-4bd6-a940-59654a69c2c6 req-8c2f10df-d13c-4296-a427-f31cd2d4e0d8 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e610cabc-8216-4bd6-a940-59654a69c2c6 req-8c2f10df-d13c-4296-a427-f31cd2d4e0d8 service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-e610cabc-8216-4bd6-a940-59654a69c2c6 req-8c2f10df-d13c-4296-a427-f31cd2d4e0d8 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-unplugged-d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-e610cabc-8216-4bd6-a940-59654a69c2c6 req-8c2f10df-d13c-4296-a427-f31cd2d4e0d8 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-d733429d-fba6-47de-b003-a9d5c4346e21 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-bb562e86-c890-4f62-b098-b3ae14af02ec req-59e01317-90d1-4f91-8d21-e1c9806538ce service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bb562e86-c890-4f62-b098-b3ae14af02ec req-59e01317-90d1-4f91-8d21-e1c9806538ce service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bb562e86-c890-4f62-b098-b3ae14af02ec req-59e01317-90d1-4f91-8d21-e1c9806538ce service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bb562e86-c890-4f62-b098-b3ae14af02ec req-59e01317-90d1-4f91-8d21-e1c9806538ce service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-bb562e86-c890-4f62-b098-b3ae14af02ec req-59e01317-90d1-4f91-8d21-e1c9806538ce service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-unplugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-bb562e86-c890-4f62-b098-b3ae14af02ec req-59e01317-90d1-4f91-8d21-e1c9806538ce service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:22 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Instance destroyed successfully.
Nov 10 12:07:22 user nova-compute[74889]: DEBUG nova.objects.instance [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lazy-loading 'resources' on Instance uuid c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "address": "fa:16:3e:97:e4:8d", "network": {"id": "6b96d1cd-7c4f-4821-bb85-166b161ef722", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2037813742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27c48730-a1", "ovs_interfaceid": "27c48730-a168-4ccf-92d4-9e7d6aff5354", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=27c48730-a168-4ccf-92d4-9e7d6aff5354,network=Network(6b96d1cd-7c4f-4821-bb85-166b161ef722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c48730-a1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=27c48730-a168-4ccf-92d4-9e7d6aff5354,network=Network(6b96d1cd-7c4f-4821-bb85-166b161ef722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c48730-a1') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27c48730-a1, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "14b9e652-8956-4e69-96e1-0677c49381f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "14b9e652-8956-4e69-96e1-0677c49381f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.objects.instance [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'flavor' on Instance uuid 14b9e652-8956-4e69-96e1-0677c49381f1 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "14b9e652-8956-4e69-96e1-0677c49381f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94b598f6-dabe-470b-ba70-2b707fb2e4b1) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: INFO os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:e4:8d,bridge_name='br-int',has_traffic_filtering=True,id=27c48730-a168-4ccf-92d4-9e7d6aff5354,network=Network(6b96d1cd-7c4f-4821-bb85-166b161ef722),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27c48730-a1')
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:93,bridge_name='br-int',has_traffic_filtering=True,id=d733429d-fba6-47de-b003-a9d5c4346e21,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd733429d-fb') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:93,bridge_name='br-int',has_traffic_filtering=True,id=d733429d-fba6-47de-b003-a9d5c4346e21,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd733429d-fb') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd733429d-fb, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7355e887-3c35-454c-97b8-c90ec6869088) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "14b9e652-8956-4e69-96e1-0677c49381f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "14b9e652-8956-4e69-96e1-0677c49381f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: INFO nova.compute.manager [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Attaching volume edb92ccd-4d6b-413f-adb8-e31646164ba1 to /dev/vdb
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: INFO os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:0a:93,bridge_name='br-int',has_traffic_filtering=True,id=d733429d-fba6-47de-b003-a9d5c4346e21,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd733429d-fb')
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:87:cb,bridge_name='br-int',has_traffic_filtering=True,id=1abcaa96-1230-47d1-b313-c9a1a217747e,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1abcaa96-12') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:87:cb,bridge_name='br-int',has_traffic_filtering=True,id=1abcaa96-1230-47d1-b313-c9a1a217747e,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1abcaa96-12') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1abcaa96-12, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aaea822d-a478-44fc-abe5-3b9f726a73e8) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: INFO os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:87:cb,bridge_name='br-int',has_traffic_filtering=True,id=1abcaa96-1230-47d1-b313-c9a1a217747e,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1abcaa96-12')
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d3:08,bridge_name='br-int',has_traffic_filtering=True,id=34906c48-ea17-444c-985b-f9b356e0ccd9,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34906c48-ea') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d3:08,bridge_name='br-int',has_traffic_filtering=True,id=34906c48-ea17-444c-985b-f9b356e0ccd9,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34906c48-ea') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34906c48-ea, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-d733429d-fba6-47de-b003-a9d5c4346e21 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: WARNING nova.compute.manager [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-d733429d-fba6-47de-b003-a9d5c4346e21 for instance with vm_state active and task_state deleting.
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-unplugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: WARNING nova.compute.manager [req-2e1fc462-af80-42ea-acd6-ea4dd4738ef7 req-e2df84ab-fdd0-43a1-8f20-d4251f33cc4b service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 for instance with vm_state active and task_state deleting.
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-1abcaa96-1230-47d1-b313-c9a1a217747e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: WARNING nova.compute.manager [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-1abcaa96-1230-47d1-b313-c9a1a217747e for instance with vm_state active and task_state deleting.
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-unplugged-34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-34906c48-ea17-444c-985b-f9b356e0ccd9 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: WARNING nova.compute.manager [req-e3db1f1f-dc54-463a-8123-3483833d7326 req-c9700eb0-a922-4946-b068-9cb7ce24815f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-34906c48-ea17-444c-985b-f9b356e0ccd9 for instance with vm_state active and task_state deleting.
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0155c074-e25d-4d9d-9ca3-47a013472ccb) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: INFO os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d3:08,bridge_name='br-int',has_traffic_filtering=True,id=34906c48-ea17-444c-985b-f9b356e0ccd9,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34906c48-ea')
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=d9cbe8cb-6d2c-4288-8582-4b6b240f97d1,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cbe8cb-6d') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=d9cbe8cb-6d2c-4288-8582-4b6b240f97d1,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cbe8cb-6d') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9cbe8cb-6d, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: WARNING nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-27c48730-a168-4ccf-92d4-9e7d6aff5354 for instance with vm_state active and task_state deleting.
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-unplugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: WARNING nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 for instance with vm_state active and task_state deleting.
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-unplugged-af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-unplugged-af1150be-d621-4fff-8dc4-c296e3310ba7 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-plugged-af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Acquiring lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] No waiting events found dispatching network-vif-plugged-af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:07:23 user nova-compute[74889]: WARNING nova.compute.manager [req-57e14343-8c81-4530-9726-c2dcfcea50bb req-dd65db4c-94ff-474b-b516-0166f60fb15f service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received unexpected event network-vif-plugged-af1150be-d621-4fff-8dc4-c296e3310ba7 for instance with vm_state active and task_state deleting.
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.utils [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ef07587-63d5-4212-ae0b-b411c5277784) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2e1865-e943-441d-bf0f-05f5a595621d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:23 user nova-compute[74889]: INFO os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:86:d5,bridge_name='br-int',has_traffic_filtering=True,id=d9cbe8cb-6d2c-4288-8582-4b6b240f97d1,network=Network(e58955a5-e29c-4d42-85d9-b4e02852ff8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9cbe8cb-6d')
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4e3ef5-97') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4e3ef5-97') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a4e3ef5-97, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[129e96fa-3509-431b-a5e0-cf8156f9284b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d023a0f3-00fe-450f-81ec-8ccf620b6656) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c62184f-ae29-4c7c-a991-0c92afefc658]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:23 user nova-compute[74889]: INFO os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:f6:07,bridge_name='br-int',has_traffic_filtering=True,id=4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4e3ef5-97')
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1980518752',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1980518752',id=28,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr5gexuZjbbq0S+OiTRD/s69kT9+aShdam3UTU0BAmL22YrzrByixwKthAJFZcdiLCyShyqIByyv+FDmrXcJ8/2P2acqtYOUpPvgAvrjN8UHzHAv+8tGA9if6Sp343F1Q==',key_name='tempest-keypair-836016089',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:06:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe879f025d6b4b0088efafe9e1e57a6e',ramdisk_id='',reservation_id='r-qp35uf06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1528117072',owner_user_name='tempest-TaggedBootDevicesTest-1528117072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:06:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ee603f962d94b498c975400029859a9',uuid=c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converting VIF {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d8:b0,bridge_name='br-int',has_traffic_filtering=True,id=af1150be-d621-4fff-8dc4-c296e3310ba7,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1150be-d6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d8:b0,bridge_name='br-int',has_traffic_filtering=True,id=af1150be-d621-4fff-8dc4-c296e3310ba7,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1150be-d6') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03bb6a2-e01c-4f78-951d-43b3c98ddaac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf1150be-d6, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b31be0e8-2e25-4c10-bc04-83b8623aac2c) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:23 user nova-compute[74889]: INFO os_vif [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d8:b0,bridge_name='br-int',has_traffic_filtering=True,id=af1150be-d621-4fff-8dc4-c296e3310ba7,network=Network(3a53e601-3315-4309-918e-3613bc863b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf1150be-d6')
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:07:23 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32716c2-c9d2-4633-97cb-d681c61cd5ee]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.utils [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Updating existing volume attachment record: b4e70db7-55f0-447c-8f8d-b8690a7800f9 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFfcsbmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:07:23 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7901267e-e734-48bf-885f-950c1bdc015e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:07:23 user nova-compute[74889]: No targets found.
Nov 10 12:07:23 user nova-compute[74889]: iSNS:
Nov 10 12:07:23 user nova-compute[74889]: No targets found.
Nov 10 12:07:23 user nova-compute[74889]: STATIC:
Nov 10 12:07:23 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2
Nov 10 12:07:23 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:23 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:23 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:07:23 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:23 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:23 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605
Nov 10 12:07:23 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:23 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:23 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:07:23 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:23 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:23 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c
Nov 10 12:07:23 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:23 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:23 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1
Nov 10 12:07:23 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:23 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:23 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6
Nov 10 12:07:23 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:23 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:23 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0
Nov 10 12:07:23 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:23 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:23 user nova-compute[74889]: FIRMWARE:
Nov 10 12:07:23 user nova-compute[74889]: No targets found.
Nov 10 12:07:23 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:07:23 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:07:23 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6915eb-c862-4870-b588-e6f9c8270815]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b57c574-9d74-47b5-9a90-1451fa0af310]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c (non-flash)
Nov 10 12:07:23 user nova-compute[74889]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6 (non-flash)
Nov 10 12:07:23 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3983d32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605'): ({'sdg'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Removing single pathed devices sdg {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd27aaa5-73d2-4ddd-8857-65b06a29effd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8cded5-46b1-4e22-a1ca-279723e4cca5]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Flushing IO for device /dev/sdg {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cdf256-9d4a-4285-b76b-40b9e97fea4b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8faf62-34f3-4487-af2a-5b24c5fabfcb]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] SCSI volumes sdg have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acaf224-4f2f-4c22-9dfd-969d45d14b2e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7456bc2-77c9-477f-8556-883a8ee2f03d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605, portal: 172.16.0.220,3260]
Nov 10 12:07:24 user nova-compute[74889]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605, portal: 172.16.0.220,3260] successful.
Nov 10 12:07:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:095c018d-6937-489d-b155-97dded277605 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[25151de7-3416-4264-8f6b-6de88c49434e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] <== disconnect_volume: return (392ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzbikVmQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:07:24 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a4a9ea-3790-4e03-ab5a-e72db80690bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:07:24 user nova-compute[74889]: No targets found.
Nov 10 12:07:24 user nova-compute[74889]: iSNS:
Nov 10 12:07:24 user nova-compute[74889]: No targets found.
Nov 10 12:07:24 user nova-compute[74889]: STATIC:
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: FIRMWARE:
Nov 10 12:07:24 user nova-compute[74889]: No targets found.
Nov 10 12:07:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:07:24 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:07:24 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16977c6-151b-4c8a-840c-011ff61041f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa4f60a-5e4d-4997-9497-a945f85442c0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3983d32e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0596b1d6-184f-4394-bcc6-49f3cac8785d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de19d8f-e521-4ba6-98bd-85f9a65e922f]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3600bf-f875-4f4f-a1f5-cdb406f37e06]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ba91e4-041c-4ae4-a06a-034dd1a8b3fb]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4206c619-5ac1-451f-8017-aa4539e0a094]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[581a9aa7-8e7d-4d14-9e1d-9118de08c0a5]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2, portal: 172.16.0.220,3260]
Nov 10 12:07:24 user nova-compute[74889]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2, portal: 172.16.0.220,3260] successful.
Nov 10 12:07:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:891ad49b-fc2c-4a7d-a076-b163bb8f41d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[728337fb-6ae7-47af-96cc-4cfe3734119c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] <== disconnect_volume: return (340ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jXgnbFUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:07:24 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4359fa5c-212b-4516-b093-021da255e03a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:07:24 user nova-compute[74889]: No targets found.
Nov 10 12:07:24 user nova-compute[74889]: iSNS:
Nov 10 12:07:24 user nova-compute[74889]: No targets found.
Nov 10 12:07:24 user nova-compute[74889]: STATIC:
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0
Nov 10 12:07:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:07:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:07:24 user nova-compute[74889]: FIRMWARE:
Nov 10 12:07:24 user nova-compute[74889]: No targets found.
Nov 10 12:07:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:07:24 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:07:24 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7af220-af6d-46ed-977a-4d4755b8fce2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b56973-7f14-4690-a445-a6b89c0c2219]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:061a82fa-a8dc-4472-bcd8-56026df8769c (non-flash)
Nov 10 12:07:24 user nova-compute[74889]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a82a9040-a059-4a20-a4c2-e2ec63dcbaa6 (non-flash)
Nov 10 12:07:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398226e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0'): ({'sdf'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Removing single pathed devices sdf {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6851e387-d2df-4a76-a365-9dc8b439559c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[982c0a59-7fdb-409c-8389-23aa09cda5ab]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Flushing IO for device /dev/sdf {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac31040-4380-4e23-8670-2e279314b97d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdce60b-1a3a-4f75-8945-13777345e06f]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] SCSI volumes sdf have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2a0492-52fe-4f55-a518-73c5721fad43]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6682abf1-07ab-45d8-9c5b-e992f4c01feb]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0, portal: 172.16.0.220,3260]
Nov 10 12:07:24 user nova-compute[74889]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0, portal: 172.16.0.220,3260] successful.
Nov 10 12:07:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59e6264-c07d-4556-b4b5-41b88c204af0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cf8ac2-feea-4cc7-9cc6-09e401089614]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] <== disconnect_volume: return (316ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:07:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:07:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Deleting instance files /opt/stack/data/nova/instances/c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3_del
Nov 10 12:07:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Deletion of /opt/stack/data/nova/instances/c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3_del complete
Nov 10 12:07:25 user nova-compute[74889]: INFO nova.compute.manager [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Took 4.13 seconds to destroy the instance on the hypervisor.
Nov 10 12:07:25 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:07:25 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:07:25 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:07:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-39381f4b-2968-465a-9a51-2fd4da58544f req-052e1cfb-723d-41bf-b62a-1f6de879ad1a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-deleted-27c48730-a168-4ccf-92d4-9e7d6aff5354 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:27 user nova-compute[74889]: INFO nova.compute.manager [req-39381f4b-2968-465a-9a51-2fd4da58544f req-052e1cfb-723d-41bf-b62a-1f6de879ad1a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Neutron deleted interface 27c48730-a168-4ccf-92d4-9e7d6aff5354; detaching it from the instance and deleting it from the info cache
Nov 10 12:07:27 user nova-compute[74889]: DEBUG nova.network.neutron [req-39381f4b-2968-465a-9a51-2fd4da58544f req-052e1cfb-723d-41bf-b62a-1f6de879ad1a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [{"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "address": "fa:16:3e:27:86:d5", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9cbe8cb-6d", "ovs_interfaceid": "d9cbe8cb-6d2c-4288-8582-4b6b240f97d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-39381f4b-2968-465a-9a51-2fd4da58544f req-052e1cfb-723d-41bf-b62a-1f6de879ad1a service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Detach interface failed, port_id=27c48730-a168-4ccf-92d4-9e7d6aff5354, reason: Instance c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:07:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-deleted-d9cbe8cb-6d2c-4288-8582-4b6b240f97d1 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:29 user nova-compute[74889]: INFO nova.compute.manager [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Neutron deleted interface d9cbe8cb-6d2c-4288-8582-4b6b240f97d1; detaching it from the instance and deleting it from the info cache
Nov 10 12:07:29 user nova-compute[74889]: DEBUG nova.network.neutron [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [{"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34906c48-ea17-444c-985b-f9b356e0ccd9", "address": "fa:16:3e:0b:d3:08", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34906c48-ea", "ovs_interfaceid": "34906c48-ea17-444c-985b-f9b356e0ccd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Detach interface failed, port_id=d9cbe8cb-6d2c-4288-8582-4b6b240f97d1, reason: Instance c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:07:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-deleted-34906c48-ea17-444c-985b-f9b356e0ccd9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:29 user nova-compute[74889]: INFO nova.compute.manager [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Neutron deleted interface 34906c48-ea17-444c-985b-f9b356e0ccd9; detaching it from the instance and deleting it from the info cache
Nov 10 12:07:29 user nova-compute[74889]: DEBUG nova.network.neutron [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [{"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "address": "fa:16:3e:28:f6:07", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4e3ef5-97", "ovs_interfaceid": "4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Detach interface failed, port_id=34906c48-ea17-444c-985b-f9b356e0ccd9, reason: Instance c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:07:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-deleted-4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:29 user nova-compute[74889]: INFO nova.compute.manager [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Neutron deleted interface 4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9; detaching it from the instance and deleting it from the info cache
Nov 10 12:07:29 user nova-compute[74889]: DEBUG nova.network.neutron [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [{"id": "d733429d-fba6-47de-b003-a9d5c4346e21", "address": "fa:16:3e:06:0a:93", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd733429d-fb", "ovs_interfaceid": "d733429d-fba6-47de-b003-a9d5c4346e21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1abcaa96-1230-47d1-b313-c9a1a217747e", "address": "fa:16:3e:cd:87:cb", "network": {"id": "e58955a5-e29c-4d42-85d9-b4e02852ff8e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1272787849", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1abcaa96-12", "ovs_interfaceid": "1abcaa96-1230-47d1-b313-c9a1a217747e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af1150be-d621-4fff-8dc4-c296e3310ba7", "address": "fa:16:3e:88:d8:b0", "network": {"id": "3a53e601-3315-4309-918e-3613bc863b82", "bridge": "br-int", "label": "tempest-device-tagging-net2-1367686200", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fe879f025d6b4b0088efafe9e1e57a6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf1150be-d6", "ovs_interfaceid": "af1150be-d621-4fff-8dc4-c296e3310ba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-a1dbc626-681f-4e92-a51e-2e8211d79abd req-5160c563-d082-4459-9ea9-dc3065fe31fa service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Detach interface failed, port_id=4a4e3ef5-9702-4a0c-a15f-aa55fa5832f9, reason: Instance c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:07:29 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:29 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Took 4.87 seconds to deallocate network for instance.
Nov 10 12:07:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-e8f99f04-e009-4132-a7a1-cb7368a6836f req-ce59db3e-3854-4d65-859b-7ed41540a888 service nova] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Received event network-vif-deleted-af1150be-d621-4fff-8dc4-c296e3310ba7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCqGZBEy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:07:37 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:07:37 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:07:37 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7a6ba5-1239-4564-b65a-0494d9e67e56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:07:37 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[409bc0cc-96ed-4fe5-bd19-7455242709b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5] added
Nov 10 12:07:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99b6d59-13f1-4012-a9b7-636a48817f3c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56b8d78-2430-4233-bc34-95a9e4c37987]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCqGZBEy {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DCqGZBEy" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca9f71a-c8a9-4778-8200-4d407baedc75]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DCqGZBEy'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdd1d8d-b6a2-4876-b911-cfe62fc548cc]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8038a61b-16f0-4255-a137-5769a68ba6a0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:07:37 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:07:37 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:07:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:07:37 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:07:37 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:07:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f967ae0-4c3f-4475-9712-280e219ff31f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5, portal: 172.16.0.220,3260]
Nov 10 12:07:37 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5, portal: 172.16.0.220,3260] successful.
Nov 10 12:07:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[03afbc35-6761-495b-8c6f-9232a85ff7ac]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f992cc5-06f0-4c8a-b52f-3453fe368c0c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:07:37 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:07:37 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:07:37 user nova-compute[74889]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)
Nov 10 12:07:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:07:37 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:07:37 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:07:37 user nova-compute[74889]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)
Nov 10 12:07:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bc4d1c-c9da-40cb-ba95-5741eb67a190]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:07:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:07:38 user nova-compute[74889]: INFO nova.compute.claims [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Claim successful on node user
Nov 10 12:07:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCqGZBEy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26636633533383466', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636633533383466', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lazy-loading 'flavor' on Instance uuid c12c5975-867c-46fb-897a-1adc16ab47b3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:07:38 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:07:38 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 12:07:38 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:07:38 user nova-compute[74889]:   <serial>31233c75-f639-40c1-970a-2ee90d94c6b5</serial>
Nov 10 12:07:38 user nova-compute[74889]: </disk>
Nov 10 12:07:38 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:07:38 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:07:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:07:39 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:07:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:07:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:07:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:07:39 user nova-compute[74889]: INFO nova.virt.block_device [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Booting with volume snapshot 348acb1b-69ee-4aee-868d-6c97ddd41dd2 at /dev/vda
Nov 10 12:07:39 user nova-compute[74889]: DEBUG nova.policy [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b53b32c4dd094fb4a4b0618dc619b21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e703b195816426d9054c28fa6cd15cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.volume.cinder [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Update attachment failed for attachment b4e70db7-55f0-447c-8f8d-b8690a7800f9. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-eee9085a-6ca3-4aee-8e95-b48c6f44b3d1) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-eee9085a-6ca3-4aee-8e95-b48c6f44b3d1)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.volume.cinder [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Update attachment failed for attachment 86d2199e-d394-4e15-9e3c-8ee78c36d7ae. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7dbec909-48c6-4617-994b-1ebd8842234c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7dbec909-48c6-4617-994b-1ebd8842234c)
Nov 10 12:07:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:07:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:07:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] No VIF found with MAC fa:16:3e:f1:a7:50, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Failed to attach edb92ccd-4d6b-413f-adb8-e31646164ba1 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-eee9085a-6ca3-4aee-8e95-b48c6f44b3d1)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Traceback (most recent call last):
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     self._do_attach(context, instance, volume, volume_api,
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     self._volume_attach(context, volume, connector, instance,
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     connection_info = volume_api.attachment_update(
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     res = method(self, ctx, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     return method.func(obj, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     resp = self._update('/attachments/%s' % id, body)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     return self.request(url, method, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1]     raise exceptions.from_response(resp, body)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-eee9085a-6ca3-4aee-8e95-b48c6f44b3d1)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] 
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Failed to attach f76334cd-059e-440d-8fe3-5749c96b3d45 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7dbec909-48c6-4617-994b-1ebd8842234c)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79] Traceback (most recent call last):
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     self._do_attach(context, instance, volume, volume_api,
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     self._volume_attach(context, volume, connector, instance,
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     connection_info = volume_api.attachment_update(
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     res = method(self, ctx, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     return method.func(obj, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     resp = self._update('/attachments/%s' % id, body)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     return self.request(url, method, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79]     raise exceptions.from_response(resp, body)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7dbec909-48c6-4617-994b-1ebd8842234c)
Nov 10 12:07:39 user nova-compute[74889]: ERROR nova.compute.manager [instance: 516ca546-b343-4d97-943d-05b975b57f79] 
Nov 10 12:07:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "14b9e652-8956-4e69-96e1-0677c49381f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.234s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "516ca546-b343-4d97-943d-05b975b57f79" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.447s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server [None req-d7904196-3c64-4ae7-84d5-90b1ac444c57 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-eee9085a-6ca3-4aee-8e95-b48c6f44b3d1)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-eee9085a-6ca3-4aee-8e95-b48c6f44b3d1)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server 
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server [None req-f1bb7994-d032-4094-9b1a-c65ff949970f tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7dbec909-48c6-4617-994b-1ebd8842234c)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7dbec909-48c6-4617-994b-1ebd8842234c)
Nov 10 12:07:39 user nova-compute[74889]: ERROR oslo_messaging.rpc.server 
Nov 10 12:07:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0bbcc3a7-da2d-4a89-a63b-4adc78f4806d tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.151s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Successfully created port: 6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:07:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Successfully updated port: 6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:07:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "refresh_cache-0cedc48f-6da1-4032-aac0-cb3961ac7c50" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:07:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquired lock "refresh_cache-0cedc48f-6da1-4032-aac0-cb3961ac7c50" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:07:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:07:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-dcafd394-c727-4d00-87e1-aff1439e1b8d req-066b4ecf-53bb-45b6-b60f-d8aeff012b49 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received event network-changed-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:07:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-dcafd394-c727-4d00-87e1-aff1439e1b8d req-066b4ecf-53bb-45b6-b60f-d8aeff012b49 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Refreshing instance network info cache due to event network-changed-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:07:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-dcafd394-c727-4d00-87e1-aff1439e1b8d req-066b4ecf-53bb-45b6-b60f-d8aeff012b49 service nova] Acquiring lock "refresh_cache-0cedc48f-6da1-4032-aac0-cb3961ac7c50" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:07:40 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Updating instance_info_cache with network_info: [{"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Releasing lock "refresh_cache-0cedc48f-6da1-4032-aac0-cb3961ac7c50" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Instance network_info: |[{"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-dcafd394-c727-4d00-87e1-aff1439e1b8d req-066b4ecf-53bb-45b6-b60f-d8aeff012b49 service nova] Acquired lock "refresh_cache-0cedc48f-6da1-4032-aac0-cb3961ac7c50" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-dcafd394-c727-4d00-87e1-aff1439e1b8d req-066b4ecf-53bb-45b6-b60f-d8aeff012b49 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Refreshing network info cache for port 6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:07:41 user nova-compute[74889]: INFO nova.compute.manager [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] [instance: c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3] Took 11.67 seconds to detach 3 volumes for instance.
Nov 10 12:07:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-dcafd394-c727-4d00-87e1-aff1439e1b8d req-066b4ecf-53bb-45b6-b60f-d8aeff012b49 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Updated VIF entry in instance network info cache for port 6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-dcafd394-c727-4d00-87e1-aff1439e1b8d req-066b4ecf-53bb-45b6-b60f-d8aeff012b49 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Updating instance_info_cache with network_info: [{"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-dcafd394-c727-4d00-87e1-aff1439e1b8d req-066b4ecf-53bb-45b6-b60f-d8aeff012b49 service nova] Releasing lock "refresh_cache-0cedc48f-6da1-4032-aac0-cb3961ac7c50" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:07:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:41 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Deleted allocations for instance c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3
Nov 10 12:07:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-5e6cb5d3-f1d1-45f7-8b46-0f94965bde5a tempest-TaggedBootDevicesTest-1528117072 tempest-TaggedBootDevicesTest-1528117072-project-member] Lock "c4e15b28-2ebf-487d-b95e-c4fd7ff46bc3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.198s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:43 user nova-compute[74889]: WARNING nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 10 12:07:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 19d4137a-5cdf-42d1-8846-35813d6360f6 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 22718082-4c44-4384-8692-c216bb1a14e4 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 1aaa9255-2adb-4f1e-8952-af99a86fa99d {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 516ca546-b343-4d97-943d-05b975b57f79 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid a37438e5-4f27-439c-a9f9-c3f9aa396d94 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid c12c5975-867c-46fb-897a-1adc16ab47b3 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 14b9e652-8956-4e69-96e1-0677c49381f1 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 0cedc48f-6da1-4032-aac0-cb3961ac7c50 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "19d4137a-5cdf-42d1-8846-35813d6360f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "22718082-4c44-4384-8692-c216bb1a14e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "22718082-4c44-4384-8692-c216bb1a14e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "516ca546-b343-4d97-943d-05b975b57f79" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "516ca546-b343-4d97-943d-05b975b57f79" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "14b9e652-8956-4e69-96e1-0677c49381f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "14b9e652-8956-4e69-96e1-0677c49381f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "22718082-4c44-4384-8692-c216bb1a14e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "516ca546-b343-4d97-943d-05b975b57f79" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "14b9e652-8956-4e69-96e1-0677c49381f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.128s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:07:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:07:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:07:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:07:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:07:48 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:07:48 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7747MB free_disk=25.382362365722656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 22718082-4c44-4384-8692-c216bb1a14e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 516ca546-b343-4d97-943d-05b975b57f79 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 1aaa9255-2adb-4f1e-8952-af99a86fa99d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance c12c5975-867c-46fb-897a-1adc16ab47b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 14b9e652-8956-4e69-96e1-0677c49381f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 0cedc48f-6da1-4032-aac0-cb3961ac7c50 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing inventories for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating ProviderTree inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing aggregate associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, aggregates: None {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:07:48 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing trait associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 12:07:49 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:07:49 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:07:49 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:07:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:07:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Updating instance_info_cache with network_info: [{"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-22718082-4c44-4384-8692-c216bb1a14e4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:07:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:07:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:07:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:07:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:07:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG os_brick.utils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f1271a-f14d-4074-984f-f44b2dfb3495]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[27063d08-66bb-4e3f-9009-75cf4572887e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8c189e-d18f-4169-a6c1-45a635ff2690]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a056c4-28eb-49d4-b97a-a8107e4a5203]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:08:00 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:08:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a242f6c-5882-4ae3-9536-56d1968dda4f]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG os_brick.utils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:08:00 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Updating existing volume attachment record: f735e13e-e461-42b3-8a94-879a3b7dd3ee {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:08:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "22718082-4c44-4384-8692-c216bb1a14e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "22718082-4c44-4384-8692-c216bb1a14e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "22718082-4c44-4384-8692-c216bb1a14e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "22718082-4c44-4384-8692-c216bb1a14e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "22718082-4c44-4384-8692-c216bb1a14e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:08:02 user nova-compute[74889]: INFO nova.compute.manager [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Terminating instance
Nov 10 12:08:02 user nova-compute[74889]: DEBUG nova.compute.manager [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:08:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-0443c8cb-7d5a-461c-957b-24504596cfbc req-d533c251-a715-4087-ad68-3aa34690df00 service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Received event network-vif-unplugged-8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0443c8cb-7d5a-461c-957b-24504596cfbc req-d533c251-a715-4087-ad68-3aa34690df00 service nova] Acquiring lock "22718082-4c44-4384-8692-c216bb1a14e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0443c8cb-7d5a-461c-957b-24504596cfbc req-d533c251-a715-4087-ad68-3aa34690df00 service nova] Lock "22718082-4c44-4384-8692-c216bb1a14e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0443c8cb-7d5a-461c-957b-24504596cfbc req-d533c251-a715-4087-ad68-3aa34690df00 service nova] Lock "22718082-4c44-4384-8692-c216bb1a14e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-0443c8cb-7d5a-461c-957b-24504596cfbc req-d533c251-a715-4087-ad68-3aa34690df00 service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] No waiting events found dispatching network-vif-unplugged-8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-0443c8cb-7d5a-461c-957b-24504596cfbc req-d533c251-a715-4087-ad68-3aa34690df00 service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Received event network-vif-unplugged-8d58ace8-d425-4267-8f74-885aced29342 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:08:03 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Instance destroyed successfully.
Nov 10 12:08:03 user nova-compute[74889]: DEBUG nova.objects.instance [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lazy-loading 'resources' on Instance uuid 22718082-4c44-4384-8692-c216bb1a14e4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-416891570',display_name='tempest-ServersNegativeTestJSON-server-416891570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-416891570',id=17,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:58:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e625bfb83b44435db8d8935883a7995f',ramdisk_id='',reservation_id='r-xydacopi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1939998126',owner_user_name='tempest-ServersNegativeTestJSON-1939998126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:58:47Z,user_data=None,user_id='aa5f0e22f91049d6ae70a72bc14df5c7',uuid=22718082-4c44-4384-8692-c216bb1a14e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converting VIF {"id": "8d58ace8-d425-4267-8f74-885aced29342", "address": "fa:16:3e:9a:8a:65", "network": {"id": "3abbb1fa-b17b-4774-8b4b-7e703b2b9c45", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1812947170-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e625bfb83b44435db8d8935883a7995f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d58ace8-d4", "ovs_interfaceid": "8d58ace8-d425-4267-8f74-885aced29342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:8a:65,bridge_name='br-int',has_traffic_filtering=True,id=8d58ace8-d425-4267-8f74-885aced29342,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d58ace8-d4') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG os_vif [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:8a:65,bridge_name='br-int',has_traffic_filtering=True,id=8d58ace8-d425-4267-8f74-885aced29342,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d58ace8-d4') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d58ace8-d4, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55ce64eb-d1ba-4991-a543-776c27853505) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:03 user nova-compute[74889]: INFO os_vif [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:8a:65,bridge_name='br-int',has_traffic_filtering=True,id=8d58ace8-d425-4267-8f74-885aced29342,network=Network(3abbb1fa-b17b-4774-8b4b-7e703b2b9c45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d58ace8-d4')
Nov 10 12:08:03 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Deleting instance files /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4_del
Nov 10 12:08:03 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Deletion of /opt/stack/data/nova/instances/22718082-4c44-4384-8692-c216bb1a14e4_del complete
Nov 10 12:08:03 user nova-compute[74889]: INFO nova.compute.manager [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 10 12:08:03 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:08:03 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:08:04 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:08:04 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Took 0.66 seconds to deallocate network for instance.
Nov 10 12:08:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:04 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:08:04 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:08:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.512s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:08:04 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Deleted allocations for instance 22718082-4c44-4384-8692-c216bb1a14e4
Nov 10 12:08:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-308e5853-6c75-4b4c-aae3-20b104980106 tempest-ServersNegativeTestJSON-1939998126 tempest-ServersNegativeTestJSON-1939998126-project-member] Lock "22718082-4c44-4384-8692-c216bb1a14e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.323s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:08:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-8f90087a-0cb1-48e6-8218-cf6c823562b2 req-2922e77f-d419-4241-bdb3-0a948dda125d service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Received event network-vif-plugged-8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:08:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8f90087a-0cb1-48e6-8218-cf6c823562b2 req-2922e77f-d419-4241-bdb3-0a948dda125d service nova] Acquiring lock "22718082-4c44-4384-8692-c216bb1a14e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8f90087a-0cb1-48e6-8218-cf6c823562b2 req-2922e77f-d419-4241-bdb3-0a948dda125d service nova] Lock "22718082-4c44-4384-8692-c216bb1a14e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8f90087a-0cb1-48e6-8218-cf6c823562b2 req-2922e77f-d419-4241-bdb3-0a948dda125d service nova] Lock "22718082-4c44-4384-8692-c216bb1a14e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:08:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-8f90087a-0cb1-48e6-8218-cf6c823562b2 req-2922e77f-d419-4241-bdb3-0a948dda125d service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] No waiting events found dispatching network-vif-plugged-8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:08:05 user nova-compute[74889]: WARNING nova.compute.manager [req-8f90087a-0cb1-48e6-8218-cf6c823562b2 req-2922e77f-d419-4241-bdb3-0a948dda125d service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Received unexpected event network-vif-plugged-8d58ace8-d425-4267-8f74-885aced29342 for instance with vm_state deleted and task_state None.
Nov 10 12:08:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-8f90087a-0cb1-48e6-8218-cf6c823562b2 req-2922e77f-d419-4241-bdb3-0a948dda125d service nova] [instance: 22718082-4c44-4384-8692-c216bb1a14e4] Received event network-vif-deleted-8d58ace8-d425-4267-8f74-885aced29342 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:08:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-df26dcc1-0118-4bd3-9e70-a2c6953c68b1 req-e9d2e1f8-c2aa-466c-9d6e-fbfb387217b2 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-changed-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:08:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-df26dcc1-0118-4bd3-9e70-a2c6953c68b1 req-e9d2e1f8-c2aa-466c-9d6e-fbfb387217b2 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Refreshing instance network info cache due to event network-changed-4a76e957-2ed4-480f-8493-aef332d05f7c. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:08:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-df26dcc1-0118-4bd3-9e70-a2c6953c68b1 req-e9d2e1f8-c2aa-466c-9d6e-fbfb387217b2 service nova] Acquiring lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:08:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-df26dcc1-0118-4bd3-9e70-a2c6953c68b1 req-e9d2e1f8-c2aa-466c-9d6e-fbfb387217b2 service nova] Acquired lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:08:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-df26dcc1-0118-4bd3-9e70-a2c6953c68b1 req-e9d2e1f8-c2aa-466c-9d6e-fbfb387217b2 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Refreshing network info cache for port 4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:08:16 user nova-compute[74889]: DEBUG nova.network.neutron [req-df26dcc1-0118-4bd3-9e70-a2c6953c68b1 req-e9d2e1f8-c2aa-466c-9d6e-fbfb387217b2 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updated VIF entry in instance network info cache for port 4a76e957-2ed4-480f-8493-aef332d05f7c. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:08:16 user nova-compute[74889]: DEBUG nova.network.neutron [req-df26dcc1-0118-4bd3-9e70-a2c6953c68b1 req-e9d2e1f8-c2aa-466c-9d6e-fbfb387217b2 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updating instance_info_cache with network_info: [{"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:08:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-df26dcc1-0118-4bd3-9e70-a2c6953c68b1 req-e9d2e1f8-c2aa-466c-9d6e-fbfb387217b2 service nova] Releasing lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG nova.compute.manager [req-ee255284-1b51-4e47-9bf2-e21142cd3ff2 req-efceb42a-f153-4ea8-94eb-744d921048f8 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-changed-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG nova.compute.manager [req-ee255284-1b51-4e47-9bf2-e21142cd3ff2 req-efceb42a-f153-4ea8-94eb-744d921048f8 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Refreshing instance network info cache due to event network-changed-4a76e957-2ed4-480f-8493-aef332d05f7c. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ee255284-1b51-4e47-9bf2-e21142cd3ff2 req-efceb42a-f153-4ea8-94eb-744d921048f8 service nova] Acquiring lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ee255284-1b51-4e47-9bf2-e21142cd3ff2 req-efceb42a-f153-4ea8-94eb-744d921048f8 service nova] Acquired lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG nova.network.neutron [req-ee255284-1b51-4e47-9bf2-e21142cd3ff2 req-efceb42a-f153-4ea8-94eb-744d921048f8 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Refreshing network info cache for port 4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:17 user nova-compute[74889]: INFO nova.compute.manager [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Detaching volume fcfa18dd-feb7-4f7e-a414-5b98a470dab1
Nov 10 12:08:17 user nova-compute[74889]: INFO nova.virt.block_device [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Attempting to driver detach volume fcfa18dd-feb7-4f7e-a414-5b98a470dab1 from mountpoint /dev/vdb
Nov 10 12:08:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Attempting to detach device vdb from instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:08:17 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:08:17 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:08:17 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:08:17 user nova-compute[74889]:   <serial>fcfa18dd-feb7-4f7e-a414-5b98a470dab1</serial>
Nov 10 12:08:17 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:08:17 user nova-compute[74889]: </disk>
Nov 10 12:08:17 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:08:17 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Successfully detached device vdb from instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 from the persistent domain config.
Nov 10 12:08:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:08:17 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:08:17 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:08:17 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:08:17 user nova-compute[74889]:   <serial>fcfa18dd-feb7-4f7e-a414-5b98a470dab1</serial>
Nov 10 12:08:17 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:08:17 user nova-compute[74889]: </disk>
Nov 10 12:08:17 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG nova.network.neutron [req-ee255284-1b51-4e47-9bf2-e21142cd3ff2 req-efceb42a-f153-4ea8-94eb-744d921048f8 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updated VIF entry in instance network info cache for port 4a76e957-2ed4-480f-8493-aef332d05f7c. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG nova.network.neutron [req-ee255284-1b51-4e47-9bf2-e21142cd3ff2 req-efceb42a-f153-4ea8-94eb-744d921048f8 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updating instance_info_cache with network_info: [{"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:08:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ee255284-1b51-4e47-9bf2-e21142cd3ff2 req-efceb42a-f153-4ea8-94eb-744d921048f8 service nova] Releasing lock "refresh_cache-a37438e5-4f27-439c-a9f9-c3f9aa396d94" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:08:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:08:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:22 user nova-compute[74889]: INFO nova.compute.manager [None req-6d3cc4b3-4b87-44d3-8116-4129be31035b tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Get console output
Nov 10 12:08:22 user nova-compute[74889]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 10 12:08:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:38 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 is timed out.
Nov 10 12:08:38 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Successfully detached device vdb from instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 from the live domain config.
Nov 10 12:08:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mqiynLHa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:08:38 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabc0e7b-408c-4498-afa9-efc3898c342c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:08:38 user nova-compute[74889]: No targets found.
Nov 10 12:08:38 user nova-compute[74889]: iSNS:
Nov 10 12:08:38 user nova-compute[74889]: No targets found.
Nov 10 12:08:38 user nova-compute[74889]: STATIC:
Nov 10 12:08:38 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5
Nov 10 12:08:38 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:08:38 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:08:38 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:08:38 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:08:38 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:08:38 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:08:38 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:08:38 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:08:38 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1
Nov 10 12:08:38 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:08:38 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:08:38 user nova-compute[74889]: FIRMWARE:
Nov 10 12:08:38 user nova-compute[74889]: No targets found.
Nov 10 12:08:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:08:38 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:08:38 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5eaa0b7-0825-4e0e-9339-b6c2aacbf719]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[43778cf6-2044-4868-8c49-1b673c8410df]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:08:38 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:08:38 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:08:38 user nova-compute[74889]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)
Nov 10 12:08:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:08:38 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:08:38 user nova-compute[74889]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 (non-flash)
Nov 10 12:08:38 user nova-compute[74889]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)
Nov 10 12:08:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3883b6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3802afc-e978-4d2c-a62d-d7a3b23d2a5a]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2b3f3e-37a7-4513-9941-dd40320ce097]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[38173e6a-311c-4ffc-8f96-3d5a263b94f5]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da0489c-f88f-49b3-a0af-131266ca0013]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[35992318-6e40-4e30-9017-c19ffcbce072]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37ee6c7-c850-4370-916a-caa6d8609c00]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1, portal: 172.16.0.220,3260]
Nov 10 12:08:38 user nova-compute[74889]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1, portal: 172.16.0.220,3260] successful.
Nov 10 12:08:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fcfa18dd-feb7-4f7e-a414-5b98a470dab1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[570d5866-c205-4e09-a3ba-14f78eea2400]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] <== disconnect_volume: return (329ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:08:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:08:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'flavor' on Instance uuid a37438e5-4f27-439c-a9f9-c3f9aa396d94 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:08:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a1dac57-494a-4001-9681-9b7a9d3f2b5f tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.041s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:08:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:08:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:08:46 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:08:46 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:08:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:08:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:50 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:08:50 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7973MB free_disk=25.38992691040039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 516ca546-b343-4d97-943d-05b975b57f79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 1aaa9255-2adb-4f1e-8952-af99a86fa99d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance c12c5975-867c-46fb-897a-1adc16ab47b3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 14b9e652-8956-4e69-96e1-0677c49381f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 0cedc48f-6da1-4032-aac0-cb3961ac7c50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:08:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:08:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:08:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:08:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:08:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:08:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:08:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:08:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:08:54 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating instance_info_cache with network_info: [{"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:08:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-1aaa9255-2adb-4f1e-8952-af99a86fa99d" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:08:54 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:08:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:08:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:08:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Creating image(s)
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Ensure instance console log exists: /opt/stack/data/nova/instances/0cedc48f-6da1-4032-aac0-cb3961ac7c50/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Start _get_guest_xml network_info=[{"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-10T12:07:09Z,direct_url=<?>,disk_format='qcow2',id=8f9ea443-6014-4b65-81eb-45aecdeabaa4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-641194906',owner='1e703b195816426d9054c28fa6cd15cc',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-10T12:07:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpuXHbea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0cedc48f-6da1-4032-aac0-cb3961ac7c50', 'attached_at': '', 'detached_at': '', 'volume_id': '5bf51440-df25-428e-9014-b57bbb5bf4bc', 'serial': '5bf51440-df25-428e-9014-b57bbb5bf4bc'}, 'disk_bus': 'virtio', 'attachment_id': 'f735e13e-e461-42b3-8a94-879a3b7dd3ee', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:08:56 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:08:56 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-10T12:07:09Z,direct_url=<?>,disk_format='qcow2',id=8f9ea443-6014-4b65-81eb-45aecdeabaa4,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-641194906',owner='1e703b195816426d9054c28fa6cd15cc',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-10T12:07:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpuXHbea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:08:56 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:08:56 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:08:56 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1acb643-05ca-4189-add7-af894ccc01eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:08:56 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d47a73-4136-47d3-b9ae-1d08f4f7a839]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc] added
Nov 10 12:08:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb4915c-ca26-48de-b5b9-fb2d4a32f2f5]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac51a072-6fbe-474e-8f8b-12d15283ab15]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpuXHbea {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpuXHbea" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd970c5-703c-4f75-936c-b5d1e1e4c826]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VpuXHbea'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1feadd-cab0-4dbe-bd41-83c577cfce8b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a196bce3-b38d-4e4a-b085-b849d3a9ad40]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:08:56 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:08:56 user nova-compute[74889]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)
Nov 10 12:08:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:08:56 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:08:56 user nova-compute[74889]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)
Nov 10 12:08:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:56 user nova-compute[74889]: INFO nova.compute.manager [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Detaching volume 31233c75-f639-40c1-970a-2ee90d94c6b5
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6a9fb2-87e7-421e-b710-28095212391c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc, portal: 172.16.0.220,3260]
Nov 10 12:08:56 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc, portal: 172.16.0.220,3260] successful.
Nov 10 12:08:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a4407d-7345-40d5-9995-ae2b9182f274]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: INFO nova.virt.block_device [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Attempting to driver detach volume 31233c75-f639-40c1-970a-2ee90d94c6b5 from mountpoint /dev/vdb
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4ad172-9c2d-4c7c-a9c3-6ca1ac739658]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:08:56 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:08:56 user nova-compute[74889]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)
Nov 10 12:08:56 user nova-compute[74889]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)
Nov 10 12:08:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:08:56 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:08:56 user nova-compute[74889]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)
Nov 10 12:08:56 user nova-compute[74889]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)
Nov 10 12:08:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Attempting to detach device vdb from instance c12c5975-867c-46fb-897a-1adc16ab47b3 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:08:56 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:08:56 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 12:08:56 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:08:56 user nova-compute[74889]:   <serial>31233c75-f639-40c1-970a-2ee90d94c6b5</serial>
Nov 10 12:08:56 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:08:56 user nova-compute[74889]: </disk>
Nov 10 12:08:56 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:08:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Successfully detached device vdb from instance c12c5975-867c-46fb-897a-1adc16ab47b3 from the persistent domain config.
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c12c5975-867c-46fb-897a-1adc16ab47b3 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:08:56 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:08:56 user nova-compute[74889]:   <source dev="/dev/sdb"/>
Nov 10 12:08:56 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:08:56 user nova-compute[74889]:   <serial>31233c75-f639-40c1-970a-2ee90d94c6b5</serial>
Nov 10 12:08:56 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:08:56 user nova-compute[74889]: </disk>
Nov 10 12:08:56 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecd3c93-e191-4e24-9dad-8705d1e3904a]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c12c5975-867c-46fb-897a-1adc16ab47b3 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpuXHbea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23036636637356135', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036636637356135', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1171665668',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1171665668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1171665668',id=32,image_ref='8f9ea443-6014-4b65-81eb-45aecdeabaa4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBYQ6Fsu9zAH/x8/1C51Qia5EQotoOGb9fesbJreISzKP2+/nxYMK0LbqkEfPEub1VD2zf4yoHdIZMgwiBSj4kX1Fop8FgQfn+3Y5TKO6lemsX3KOEZuo9qCCgOyxDEKA==',key_name='tempest-keypair-437323978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-jkj0qjav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1577456798',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=0cedc48f-6da1-4032-aac0-cb3961ac7c50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8424b5-cf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.objects.instance [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lazy-loading 'pci_devices' on Instance uuid 0cedc48f-6da1-4032-aac0-cb3961ac7c50 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:08:57 user nova-compute[74889]:   <uuid>0cedc48f-6da1-4032-aac0-cb3961ac7c50</uuid>
Nov 10 12:08:57 user nova-compute[74889]:   <name>instance-00000020</name>
Nov 10 12:08:57 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:08:57 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:08:57 user nova-compute[74889]:   <metadata>
Nov 10 12:08:57 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:08:57 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:08:57 user nova-compute[74889]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1171665668</nova:name>
Nov 10 12:08:57 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:08:56</nova:creationTime>
Nov 10 12:08:57 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:08:57 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:08:57 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:08:57 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:08:57 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:08:57 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:08:57 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:08:57 user nova-compute[74889]:       <nova:owner>
Nov 10 12:08:57 user nova-compute[74889]:         <nova:user uuid="b53b32c4dd094fb4a4b0618dc619b21f">tempest-TestVolumeBootPattern-1577456798-project-member</nova:user>
Nov 10 12:08:57 user nova-compute[74889]:         <nova:project uuid="1e703b195816426d9054c28fa6cd15cc">tempest-TestVolumeBootPattern-1577456798</nova:project>
Nov 10 12:08:57 user nova-compute[74889]:       </nova:owner>
Nov 10 12:08:57 user nova-compute[74889]:       <nova:root type="image" uuid="8f9ea443-6014-4b65-81eb-45aecdeabaa4"/>
Nov 10 12:08:57 user nova-compute[74889]:       <nova:ports>
Nov 10 12:08:57 user nova-compute[74889]:         <nova:port uuid="6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d">
Nov 10 12:08:57 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 12:08:57 user nova-compute[74889]:         </nova:port>
Nov 10 12:08:57 user nova-compute[74889]:       </nova:ports>
Nov 10 12:08:57 user nova-compute[74889]:     </nova:instance>
Nov 10 12:08:57 user nova-compute[74889]:   </metadata>
Nov 10 12:08:57 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:08:57 user nova-compute[74889]:     <system>
Nov 10 12:08:57 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:08:57 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:08:57 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:08:57 user nova-compute[74889]:       <entry name="serial">0cedc48f-6da1-4032-aac0-cb3961ac7c50</entry>
Nov 10 12:08:57 user nova-compute[74889]:       <entry name="uuid">0cedc48f-6da1-4032-aac0-cb3961ac7c50</entry>
Nov 10 12:08:57 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:08:57 user nova-compute[74889]:     </system>
Nov 10 12:08:57 user nova-compute[74889]:   </sysinfo>
Nov 10 12:08:57 user nova-compute[74889]:   <os>
Nov 10 12:08:57 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:08:57 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:08:57 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:08:57 user nova-compute[74889]:   </os>
Nov 10 12:08:57 user nova-compute[74889]:   <features>
Nov 10 12:08:57 user nova-compute[74889]:     <acpi/>
Nov 10 12:08:57 user nova-compute[74889]:     <apic/>
Nov 10 12:08:57 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:08:57 user nova-compute[74889]:   </features>
Nov 10 12:08:57 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:08:57 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:08:57 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:08:57 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:08:57 user nova-compute[74889]:   </clock>
Nov 10 12:08:57 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:08:57 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:08:57 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:08:57 user nova-compute[74889]:   </cpu>
Nov 10 12:08:57 user nova-compute[74889]:   <devices>
Nov 10 12:08:57 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:08:57 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:08:57 user nova-compute[74889]:       <source dev="/dev/sdd"/>
Nov 10 12:08:57 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:08:57 user nova-compute[74889]:       <serial>5bf51440-df25-428e-9014-b57bbb5bf4bc</serial>
Nov 10 12:08:57 user nova-compute[74889]:     </disk>
Nov 10 12:08:57 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:08:57 user nova-compute[74889]:       <mac address="fa:16:3e:b7:0e:c3"/>
Nov 10 12:08:57 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:08:57 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:08:57 user nova-compute[74889]:       <target dev="tap6a8424b5-cf"/>
Nov 10 12:08:57 user nova-compute[74889]:     </interface>
Nov 10 12:08:57 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:08:57 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/0cedc48f-6da1-4032-aac0-cb3961ac7c50/console.log" append="off"/>
Nov 10 12:08:57 user nova-compute[74889]:     </serial>
Nov 10 12:08:57 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:08:57 user nova-compute[74889]:     <video>
Nov 10 12:08:57 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:08:57 user nova-compute[74889]:     </video>
Nov 10 12:08:57 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:08:57 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:08:57 user nova-compute[74889]:     </rng>
Nov 10 12:08:57 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:08:57 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:08:57 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:08:57 user nova-compute[74889]:     </memballoon>
Nov 10 12:08:57 user nova-compute[74889]:   </devices>
Nov 10 12:08:57 user nova-compute[74889]: </domain>
Nov 10 12:08:57 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1171665668',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1171665668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1171665668',id=32,image_ref='8f9ea443-6014-4b65-81eb-45aecdeabaa4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBYQ6Fsu9zAH/x8/1C51Qia5EQotoOGb9fesbJreISzKP2+/nxYMK0LbqkEfPEub1VD2zf4yoHdIZMgwiBSj4kX1Fop8FgQfn+3Y5TKO6lemsX3KOEZuo9qCCgOyxDEKA==',key_name='tempest-keypair-437323978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-jkj0qjav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1577456798',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=0cedc48f-6da1-4032-aac0-cb3961ac7c50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8424b5-cf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG os_vif [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8424b5-cf') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7477af21-4c07-578a-98a8-cce1ae12a1e5', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a8424b5-cf, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a8424b5-cf, col_values=(('qos', UUID('4622b4c8-bfd7-40c8-94e5-557518b01669')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a8424b5-cf, col_values=(('external_ids', {'iface-id': '6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:0e:c3', 'vm-uuid': '0cedc48f-6da1-4032-aac0-cb3961ac7c50'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:57 user nova-compute[74889]: INFO os_vif [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8424b5-cf')
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:08:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] No VIF found with MAC fa:16:3e:b7:0e:c3, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:08:58 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:08:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:08:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:08:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-0744be5c-36f4-4dc5-9aa9-7caf9d4942d2 req-26fa74a0-a675-4b9c-81b8-abdd28e2958d service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received event network-vif-plugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:08:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0744be5c-36f4-4dc5-9aa9-7caf9d4942d2 req-26fa74a0-a675-4b9c-81b8-abdd28e2958d service nova] Acquiring lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:08:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0744be5c-36f4-4dc5-9aa9-7caf9d4942d2 req-26fa74a0-a675-4b9c-81b8-abdd28e2958d service nova] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:08:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0744be5c-36f4-4dc5-9aa9-7caf9d4942d2 req-26fa74a0-a675-4b9c-81b8-abdd28e2958d service nova] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:08:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-0744be5c-36f4-4dc5-9aa9-7caf9d4942d2 req-26fa74a0-a675-4b9c-81b8-abdd28e2958d service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] No waiting events found dispatching network-vif-plugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:08:59 user nova-compute[74889]: WARNING nova.compute.manager [req-0744be5c-36f4-4dc5-9aa9-7caf9d4942d2 req-26fa74a0-a675-4b9c-81b8-abdd28e2958d service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received unexpected event network-vif-plugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d for instance with vm_state building and task_state spawning.
Nov 10 12:08:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:01 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:09:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:09:01 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Instance spawned successfully.
Nov 10 12:09:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:09:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:09:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:09:01 user nova-compute[74889]: INFO nova.compute.manager [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 10 12:09:01 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:09:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-9b69fbb4-4be3-4ec9-9ba3-758ed0951e01 req-eb1e0c67-67e3-4db0-955b-d2a56c630eb7 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received event network-vif-plugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:09:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9b69fbb4-4be3-4ec9-9ba3-758ed0951e01 req-eb1e0c67-67e3-4db0-955b-d2a56c630eb7 service nova] Acquiring lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9b69fbb4-4be3-4ec9-9ba3-758ed0951e01 req-eb1e0c67-67e3-4db0-955b-d2a56c630eb7 service nova] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9b69fbb4-4be3-4ec9-9ba3-758ed0951e01 req-eb1e0c67-67e3-4db0-955b-d2a56c630eb7 service nova] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-9b69fbb4-4be3-4ec9-9ba3-758ed0951e01 req-eb1e0c67-67e3-4db0-955b-d2a56c630eb7 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] No waiting events found dispatching network-vif-plugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:09:01 user nova-compute[74889]: WARNING nova.compute.manager [req-9b69fbb4-4be3-4ec9-9ba3-758ed0951e01 req-eb1e0c67-67e3-4db0-955b-d2a56c630eb7 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received unexpected event network-vif-plugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d for instance with vm_state active and task_state None.
Nov 10 12:09:01 user nova-compute[74889]: INFO nova.compute.manager [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Took 83.01 seconds to build instance.
Nov 10 12:09:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0508d9b7-5b5e-4f42-9183-4cf784c5fb6d tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 83.158s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 77.660s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:01 user nova-compute[74889]: INFO nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 10 12:09:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:17 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c12c5975-867c-46fb-897a-1adc16ab47b3 is timed out.
Nov 10 12:09:17 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Successfully detached device vdb from instance c12c5975-867c-46fb-897a-1adc16ab47b3 from the live domain config.
Nov 10 12:09:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCqGZBEy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:09:17 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c60f2a-08c4-4a41-8565-6aad5d3bcb40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:09:17 user nova-compute[74889]: No targets found.
Nov 10 12:09:17 user nova-compute[74889]: iSNS:
Nov 10 12:09:17 user nova-compute[74889]: No targets found.
Nov 10 12:09:17 user nova-compute[74889]: STATIC:
Nov 10 12:09:17 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5
Nov 10 12:09:17 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:09:17 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:09:17 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:09:17 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:09:17 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:09:17 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:09:17 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:09:17 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:09:17 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc
Nov 10 12:09:17 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:09:17 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:09:17 user nova-compute[74889]: FIRMWARE:
Nov 10 12:09:17 user nova-compute[74889]: No targets found.
Nov 10 12:09:17 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:09:17 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:09:17 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e444e5-a9f3-4a72-b0ef-24ce0258f5dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26ec10a-27d5-432e-86df-4bcb3f1aa2d9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:09:17 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:09:17 user nova-compute[74889]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)
Nov 10 12:09:17 user nova-compute[74889]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)
Nov 10 12:09:17 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:09:17 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:09:17 user nova-compute[74889]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 (non-flash)
Nov 10 12:09:17 user nova-compute[74889]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)
Nov 10 12:09:17 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398224550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cf6c89-887c-438d-be6e-036aad4bc6eb]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58d4935-0864-40a4-bbea-4203ebf98eef]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2889df-a602-41f1-9aa9-247f48776095]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dae5b1b-e7ce-48c9-aa00-5be24dbd42d2]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe92a27-345d-4aab-82f3-25446e824919]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[776b0493-6332-4720-addc-7dfa7b0c9b0a]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5, portal: 172.16.0.220,3260]
Nov 10 12:09:17 user nova-compute[74889]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5, portal: 172.16.0.220,3260] successful.
Nov 10 12:09:17 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eafcb3-4692-4c20-9cee-687bc00e32a7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] <== disconnect_volume: return (323ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:09:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lazy-loading 'flavor' on Instance uuid c12c5975-867c-46fb-897a-1adc16ab47b3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6a413c6e-ec22-46fc-ae55-5d90cdbe0236 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.984s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.831s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:18 user nova-compute[74889]: INFO nova.compute.manager [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Terminating instance
Nov 10 12:09:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-84e28c77-91c5-4a03-b877-660916c88a83 req-226843d6-169b-4c8f-95a8-33cfa13796b1 service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received event network-vif-unplugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-84e28c77-91c5-4a03-b877-660916c88a83 req-226843d6-169b-4c8f-95a8-33cfa13796b1 service nova] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-84e28c77-91c5-4a03-b877-660916c88a83 req-226843d6-169b-4c8f-95a8-33cfa13796b1 service nova] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-84e28c77-91c5-4a03-b877-660916c88a83 req-226843d6-169b-4c8f-95a8-33cfa13796b1 service nova] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-84e28c77-91c5-4a03-b877-660916c88a83 req-226843d6-169b-4c8f-95a8-33cfa13796b1 service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] No waiting events found dispatching network-vif-unplugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:09:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-84e28c77-91c5-4a03-b877-660916c88a83 req-226843d6-169b-4c8f-95a8-33cfa13796b1 service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received event network-vif-unplugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:09:19 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Instance destroyed successfully.
Nov 10 12:09:19 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lazy-loading 'resources' on Instance uuid c12c5975-867c-46fb-897a-1adc16ab47b3 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-161383283',display_name='tempest-VolumesSnapshotTestJSON-instance-161383283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-161383283',id=29,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ95yd6ziBJMdBUjitURX1/RLTPKTJySg+FweKNLw5ashF8AOkAiB/545ARSPhGyGkeXuRhcuH8wQ0OqKRqQG2wmdgU1ELT/8S/uuytM12nzHekGvPGfciPwF9biGPqxKA==',key_name='tempest-keypair-1175125015',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a044fadd3c4420e8eedda7501a12114',ramdisk_id='',reservation_id='r-sbvu3720',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2146398887',owner_user_name='tempest-VolumesSnapshotTestJSON-2146398887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='109e2f18063546d48270f3ae95fae53d',uuid=c12c5975-867c-46fb-897a-1adc16ab47b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converting VIF {"id": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "address": "fa:16:3e:f1:a7:50", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4637bfab-a1", "ovs_interfaceid": "4637bfab-a1e0-4684-a3e2-f140baf0b1f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:a7:50,bridge_name='br-int',has_traffic_filtering=True,id=4637bfab-a1e0-4684-a3e2-f140baf0b1f0,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4637bfab-a1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_vif [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:a7:50,bridge_name='br-int',has_traffic_filtering=True,id=4637bfab-a1e0-4684-a3e2-f140baf0b1f0,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4637bfab-a1') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4637bfab-a1, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2982528c-31d2-4d2c-a26a-3c1ad5182be3) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:09:19 user nova-compute[74889]: INFO os_vif [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:a7:50,bridge_name='br-int',has_traffic_filtering=True,id=4637bfab-a1e0-4684-a3e2-f140baf0b1f0,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4637bfab-a1')
Nov 10 12:09:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DCqGZBEy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:09:19 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd06a168-71ef-4087-9aa8-660ae5992a3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:09:19 user nova-compute[74889]: No targets found.
Nov 10 12:09:19 user nova-compute[74889]: iSNS:
Nov 10 12:09:19 user nova-compute[74889]: No targets found.
Nov 10 12:09:19 user nova-compute[74889]: STATIC:
Nov 10 12:09:19 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:09:19 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:09:19 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:09:19 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:09:19 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:09:19 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:09:19 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc
Nov 10 12:09:19 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:09:19 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:09:19 user nova-compute[74889]: FIRMWARE:
Nov 10 12:09:19 user nova-compute[74889]: No targets found.
Nov 10 12:09:19 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:09:19 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:09:19 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:31233c75-f639-40c1-970a-2ee90d94c6b5', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ead7df-5173-47ad-bc89-5b8492930138]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6251f0-c772-4a7a-bc1e-327b5d485b01]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:09:19 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:09:19 user nova-compute[74889]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)
Nov 10 12:09:19 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:09:19 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:09:19 user nova-compute[74889]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)
Nov 10 12:09:19 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398394f70>, {}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Disconnecting from: [] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] <== disconnect_volume: return (82ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:09:19 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Deleting instance files /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3_del
Nov 10 12:09:19 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Deletion of /opt/stack/data/nova/instances/c12c5975-867c-46fb-897a-1adc16ab47b3_del complete
Nov 10 12:09:19 user nova-compute[74889]: INFO nova.compute.manager [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 10 12:09:19 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:09:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:20 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:09:20 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Took 0.83 seconds to deallocate network for instance.
Nov 10 12:09:20 user nova-compute[74889]: WARNING nova.volume.cinder [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Attachment 53876955-51cf-4aa7-be2b-1dfc4297cd33 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 53876955-51cf-4aa7-be2b-1dfc4297cd33. (HTTP 404) (Request-ID: req-5ee299f0-0aa6-47bc-a22d-0c784d7d82d0)
Nov 10 12:09:20 user nova-compute[74889]: INFO nova.compute.manager [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Took 0.03 seconds to detach 1 volumes for instance.
Nov 10 12:09:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:20 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:09:20 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:09:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:20 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Deleted allocations for instance c12c5975-867c-46fb-897a-1adc16ab47b3
Nov 10 12:09:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-112c151b-93e2-4eab-a372-34ad2a85863c req-1a5b6146-8ab9-4bcc-9759-7a697d25cbef service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received event network-vif-plugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:09:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-112c151b-93e2-4eab-a372-34ad2a85863c req-1a5b6146-8ab9-4bcc-9759-7a697d25cbef service nova] Acquiring lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-112c151b-93e2-4eab-a372-34ad2a85863c req-1a5b6146-8ab9-4bcc-9759-7a697d25cbef service nova] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-112c151b-93e2-4eab-a372-34ad2a85863c req-1a5b6146-8ab9-4bcc-9759-7a697d25cbef service nova] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-112c151b-93e2-4eab-a372-34ad2a85863c req-1a5b6146-8ab9-4bcc-9759-7a697d25cbef service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] No waiting events found dispatching network-vif-plugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:09:20 user nova-compute[74889]: WARNING nova.compute.manager [req-112c151b-93e2-4eab-a372-34ad2a85863c req-1a5b6146-8ab9-4bcc-9759-7a697d25cbef service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received unexpected event network-vif-plugged-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 for instance with vm_state deleted and task_state None.
Nov 10 12:09:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-112c151b-93e2-4eab-a372-34ad2a85863c req-1a5b6146-8ab9-4bcc-9759-7a697d25cbef service nova] [instance: c12c5975-867c-46fb-897a-1adc16ab47b3] Received event network-vif-deleted-4637bfab-a1e0-4684-a3e2-f140baf0b1f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:09:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9822ec06-3774-473e-8c41-9b717ad2755a tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "c12c5975-867c-46fb-897a-1adc16ab47b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.375s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:23 user nova-compute[74889]: INFO nova.compute.manager [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Terminating instance
Nov 10 12:09:23 user nova-compute[74889]: DEBUG nova.compute.manager [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-2d7f787c-a440-4885-b1ef-539079eba622 req-6aea7fdd-5b7d-4a7f-8b04-53f680fe4349 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-vif-unplugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2d7f787c-a440-4885-b1ef-539079eba622 req-6aea7fdd-5b7d-4a7f-8b04-53f680fe4349 service nova] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2d7f787c-a440-4885-b1ef-539079eba622 req-6aea7fdd-5b7d-4a7f-8b04-53f680fe4349 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2d7f787c-a440-4885-b1ef-539079eba622 req-6aea7fdd-5b7d-4a7f-8b04-53f680fe4349 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-2d7f787c-a440-4885-b1ef-539079eba622 req-6aea7fdd-5b7d-4a7f-8b04-53f680fe4349 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] No waiting events found dispatching network-vif-unplugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:09:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-2d7f787c-a440-4885-b1ef-539079eba622 req-6aea7fdd-5b7d-4a7f-8b04-53f680fe4349 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-vif-unplugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Instance destroyed successfully.
Nov 10 12:09:24 user nova-compute[74889]: DEBUG nova.objects.instance [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'resources' on Instance uuid 1aaa9255-2adb-4f1e-8952-af99a86fa99d {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1298763924',display_name='tempest-ServerActionsTestOtherA-server-1298763924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1298763924',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV2sPROd86lDqNq7yn/OdL+EAGi3OrNcdrVAdLzqRGaXMCeQRt25LrQ3Ql1TrND/6Dz6MBX7QNwi3U9n4Q2xTxIhGV3gbETVuDolUvGcK3ZVpcr8zuoJBqyHEchy/q4SQ==',key_name='tempest-keypair-943743287',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-golc2jfc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=1aaa9255-2adb-4f1e-8952-af99a86fa99d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "address": "fa:16:3e:45:07:09", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab97e0c2-49", "ovs_interfaceid": "ab97e0c2-49c1-4812-b8c5-ede04531a6f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_vif [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab97e0c2-49, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc594008-8991-4ee1-976a-ff1101f7c410) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:24 user nova-compute[74889]: INFO os_vif [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:07:09,bridge_name='br-int',has_traffic_filtering=True,id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab97e0c2-49')
Nov 10 12:09:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHmMjaOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:09:24 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[32afdebc-d999-4973-a1df-fe4985bf698d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:09:24 user nova-compute[74889]: No targets found.
Nov 10 12:09:24 user nova-compute[74889]: iSNS:
Nov 10 12:09:24 user nova-compute[74889]: No targets found.
Nov 10 12:09:24 user nova-compute[74889]: STATIC:
Nov 10 12:09:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:09:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:09:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:09:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b
Nov 10 12:09:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:09:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:09:24 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc
Nov 10 12:09:24 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:09:24 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:09:24 user nova-compute[74889]: FIRMWARE:
Nov 10 12:09:24 user nova-compute[74889]: No targets found.
Nov 10 12:09:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:09:24 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:09:24 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78b69df-c46a-44f7-adb3-7a6c89917cb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fdfe65-c653-4fe4-86c1-e10f11769011]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:09:24 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:09:24 user nova-compute[74889]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)
Nov 10 12:09:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b (non-flash)
Nov 10 12:09:24 user nova-compute[74889]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:09:24 user nova-compute[74889]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)
Nov 10 12:09:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a009feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b'): ({'sdc'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Removing single pathed devices sdc {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05cdeac-5af0-45f9-a1e1-2871e32124ff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dacd154-1560-450b-9194-e03cfa22a393]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Flushing IO for device /dev/sdc {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9e2726-474e-40fc-9409-8c0d5a0fbb19]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a2b92e-095d-4c7b-838e-087ff25dd37f]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e4df6a-d962-4682-bb20-6cf6e5268a1c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7fa6d2-253d-4738-b81e-2d2147d3297a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260]
Nov 10 12:09:24 user nova-compute[74889]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b, portal: 172.16.0.220,3260] successful.
Nov 10 12:09:24 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13562062-f66e-40d1-8de7-ef2d8d90ff7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1daa34f-4202-4402-a10f-8eeb32171de7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] <== disconnect_volume: return (343ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:09:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Deleting instance files /opt/stack/data/nova/instances/1aaa9255-2adb-4f1e-8952-af99a86fa99d_del
Nov 10 12:09:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Deletion of /opt/stack/data/nova/instances/1aaa9255-2adb-4f1e-8952-af99a86fa99d_del complete
Nov 10 12:09:24 user nova-compute[74889]: INFO nova.compute.manager [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 10 12:09:24 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:09:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:25 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:09:25 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Took 0.89 seconds to deallocate network for instance.
Nov 10 12:09:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-69b4f8e9-8bcc-40dd-824f-581025bf0ba7 req-b7c4e940-4ed6-472b-9ec7-13b3ebc1b357 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-vif-deleted-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:09:25 user nova-compute[74889]: INFO nova.compute.manager [req-69b4f8e9-8bcc-40dd-824f-581025bf0ba7 req-b7c4e940-4ed6-472b-9ec7-13b3ebc1b357 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Neutron deleted interface ab97e0c2-49c1-4812-b8c5-ede04531a6f0; detaching it from the instance and deleting it from the info cache
Nov 10 12:09:25 user nova-compute[74889]: DEBUG nova.network.neutron [req-69b4f8e9-8bcc-40dd-824f-581025bf0ba7 req-b7c4e940-4ed6-472b-9ec7-13b3ebc1b357 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:09:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-69b4f8e9-8bcc-40dd-824f-581025bf0ba7 req-b7c4e940-4ed6-472b-9ec7-13b3ebc1b357 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Detach interface failed, port_id=ab97e0c2-49c1-4812-b8c5-ede04531a6f0, reason: Instance 1aaa9255-2adb-4f1e-8952-af99a86fa99d could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:09:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-1c7bf66a-8582-43bb-9b74-faedf06a8d6a req-3ac9f432-ff74-4755-b2e0-096aa3b06a39 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:09:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1c7bf66a-8582-43bb-9b74-faedf06a8d6a req-3ac9f432-ff74-4755-b2e0-096aa3b06a39 service nova] Acquiring lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1c7bf66a-8582-43bb-9b74-faedf06a8d6a req-3ac9f432-ff74-4755-b2e0-096aa3b06a39 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1c7bf66a-8582-43bb-9b74-faedf06a8d6a req-3ac9f432-ff74-4755-b2e0-096aa3b06a39 service nova] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-1c7bf66a-8582-43bb-9b74-faedf06a8d6a req-3ac9f432-ff74-4755-b2e0-096aa3b06a39 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] No waiting events found dispatching network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:09:25 user nova-compute[74889]: WARNING nova.compute.manager [req-1c7bf66a-8582-43bb-9b74-faedf06a8d6a req-3ac9f432-ff74-4755-b2e0-096aa3b06a39 service nova] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Received unexpected event network-vif-plugged-ab97e0c2-49c1-4812-b8c5-ede04531a6f0 for instance with vm_state active and task_state deleting.
Nov 10 12:09:26 user nova-compute[74889]: INFO nova.compute.manager [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Took 0.96 seconds to detach 1 volumes for instance.
Nov 10 12:09:26 user nova-compute[74889]: DEBUG nova.compute.manager [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 1aaa9255-2adb-4f1e-8952-af99a86fa99d] Deleting volume: 13562062-f66e-40d1-8de7-ef2d8d90ff7b {{(pid=74889) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 12:09:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:26 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:09:26 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:09:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:26 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Deleted allocations for instance 1aaa9255-2adb-4f1e-8952-af99a86fa99d
Nov 10 12:09:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-61a382c2-9d6a-47a7-ba42-e614a9864d7a tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "1aaa9255-2adb-4f1e-8952-af99a86fa99d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.571s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:09:44 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:09:46 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:09:47 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:48 user nova-compute[74889]: INFO nova.compute.manager [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Terminating instance
Nov 10 12:09:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:09:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-cb49a872-f721-480a-9760-99d7d6dc48ac req-72e3a3b9-f8c9-4178-8fa3-a6e374886704 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-vif-unplugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb49a872-f721-480a-9760-99d7d6dc48ac req-72e3a3b9-f8c9-4178-8fa3-a6e374886704 service nova] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb49a872-f721-480a-9760-99d7d6dc48ac req-72e3a3b9-f8c9-4178-8fa3-a6e374886704 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb49a872-f721-480a-9760-99d7d6dc48ac req-72e3a3b9-f8c9-4178-8fa3-a6e374886704 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-cb49a872-f721-480a-9760-99d7d6dc48ac req-72e3a3b9-f8c9-4178-8fa3-a6e374886704 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] No waiting events found dispatching network-vif-unplugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-cb49a872-f721-480a-9760-99d7d6dc48ac req-72e3a3b9-f8c9-4178-8fa3-a6e374886704 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-vif-unplugged-4a76e957-2ed4-480f-8493-aef332d05f7c for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:09:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Instance destroyed successfully.
Nov 10 12:09:49 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lazy-loading 'resources' on Instance uuid a37438e5-4f27-439c-a9f9-c3f9aa396d94 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:03:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-671676259',display_name='tempest-TestMinimumBasicScenario-server-671676259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-671676259',id=27,image_ref='fbe829ed-182b-46da-8c51-62f2090890e1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdgK6uepGNExQDq6f+TujVQ9Wy4LBwykOQIGkieJd8zFMATtV+3UvLtjXvRYhmBN89lG6KH9/ROR0FMy9Zn/wUgfMnZl6xxmAG90NICPNL7Q6otsoLTho0zY6m45O6nMQ==',key_name='tempest-TestMinimumBasicScenario-601543450',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:03:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1298008035034b9ea352dc01af38a417',ramdisk_id='',reservation_id='r-w1x3g4j8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='fbe829ed-182b-46da-8c51-62f2090890e1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1750479142',owner_user_name='tempest-TestMinimumBasicScenario-1750479142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:06:31Z,user_data=None,user_id='f59a12b24b02408e9602dd7146453a57',uuid=a37438e5-4f27-439c-a9f9-c3f9aa396d94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converting VIF {"id": "4a76e957-2ed4-480f-8493-aef332d05f7c", "address": "fa:16:3e:1f:84:ff", "network": {"id": "d0f907ba-62cc-47f1-8b8a-357906243280", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1666117537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1298008035034b9ea352dc01af38a417", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a76e957-2e", "ovs_interfaceid": "4a76e957-2ed4-480f-8493-aef332d05f7c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:84:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a76e957-2ed4-480f-8493-aef332d05f7c,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a76e957-2e') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG os_vif [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:84:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a76e957-2ed4-480f-8493-aef332d05f7c,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a76e957-2e') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a76e957-2e, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=981debf1-b8e7-418b-bd5d-d3266e4f5e5d) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:49 user nova-compute[74889]: INFO os_vif [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:84:ff,bridge_name='br-int',has_traffic_filtering=True,id=4a76e957-2ed4-480f-8493-aef332d05f7c,network=Network(d0f907ba-62cc-47f1-8b8a-357906243280),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a76e957-2e')
Nov 10 12:09:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Deleting instance files /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94_del
Nov 10 12:09:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Deletion of /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94_del complete
Nov 10 12:09:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:09:49 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001b, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/a37438e5-4f27-439c-a9f9-c3f9aa396d94/disk
Nov 10 12:09:50 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:09:50 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8113MB free_disk=25.397525787353516GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:50 user nova-compute[74889]: INFO nova.compute.manager [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 10 12:09:50 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 516ca546-b343-4d97-943d-05b975b57f79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance a37438e5-4f27-439c-a9f9-c3f9aa396d94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 14b9e652-8956-4e69-96e1-0677c49381f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 0cedc48f-6da1-4032-aac0-cb3961ac7c50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:09:50 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Took 0.51 seconds to deallocate network for instance.
Nov 10 12:09:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:51 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:09:51 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:09:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:51 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Deleted allocations for instance a37438e5-4f27-439c-a9f9-c3f9aa396d94
Nov 10 12:09:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada104d8-7986-4097-a734-686b9de1192b tempest-TestMinimumBasicScenario-1750479142 tempest-TestMinimumBasicScenario-1750479142-project-member] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.321s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-cbf5b067-9f36-4e04-ab33-c71c8beed6ae req-a510b7ff-0e98-4434-9fa7-9bde89b29de6 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:09:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cbf5b067-9f36-4e04-ab33-c71c8beed6ae req-a510b7ff-0e98-4434-9fa7-9bde89b29de6 service nova] Acquiring lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:09:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cbf5b067-9f36-4e04-ab33-c71c8beed6ae req-a510b7ff-0e98-4434-9fa7-9bde89b29de6 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:09:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cbf5b067-9f36-4e04-ab33-c71c8beed6ae req-a510b7ff-0e98-4434-9fa7-9bde89b29de6 service nova] Lock "a37438e5-4f27-439c-a9f9-c3f9aa396d94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:09:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-cbf5b067-9f36-4e04-ab33-c71c8beed6ae req-a510b7ff-0e98-4434-9fa7-9bde89b29de6 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] No waiting events found dispatching network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:09:51 user nova-compute[74889]: WARNING nova.compute.manager [req-cbf5b067-9f36-4e04-ab33-c71c8beed6ae req-a510b7ff-0e98-4434-9fa7-9bde89b29de6 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received unexpected event network-vif-plugged-4a76e957-2ed4-480f-8493-aef332d05f7c for instance with vm_state deleted and task_state None.
Nov 10 12:09:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-cbf5b067-9f36-4e04-ab33-c71c8beed6ae req-a510b7ff-0e98-4434-9fa7-9bde89b29de6 service nova] [instance: a37438e5-4f27-439c-a9f9-c3f9aa396d94] Received event network-vif-deleted-4a76e957-2ed4-480f-8493-aef332d05f7c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:09:52 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:09:52 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:09:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:09:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:09:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:09:52 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:09:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Updating instance_info_cache with network_info: [{"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:09:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-516ca546-b343-4d97-943d-05b975b57f79" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:09:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:09:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:09:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:09:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:09:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:09:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:09:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:10:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:10:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:10:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-c77d2862-d444-402a-8bee-34d91c6f3e4a req-57bebb71-5d06-48c2-9646-4d3d4889bb01 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received event network-changed-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:10:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-c77d2862-d444-402a-8bee-34d91c6f3e4a req-57bebb71-5d06-48c2-9646-4d3d4889bb01 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Refreshing instance network info cache due to event network-changed-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:10:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c77d2862-d444-402a-8bee-34d91c6f3e4a req-57bebb71-5d06-48c2-9646-4d3d4889bb01 service nova] Acquiring lock "refresh_cache-0cedc48f-6da1-4032-aac0-cb3961ac7c50" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:10:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c77d2862-d444-402a-8bee-34d91c6f3e4a req-57bebb71-5d06-48c2-9646-4d3d4889bb01 service nova] Acquired lock "refresh_cache-0cedc48f-6da1-4032-aac0-cb3961ac7c50" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:10:19 user nova-compute[74889]: DEBUG nova.network.neutron [req-c77d2862-d444-402a-8bee-34d91c6f3e4a req-57bebb71-5d06-48c2-9646-4d3d4889bb01 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Refreshing network info cache for port 6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:10:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:19 user nova-compute[74889]: DEBUG nova.network.neutron [req-c77d2862-d444-402a-8bee-34d91c6f3e4a req-57bebb71-5d06-48c2-9646-4d3d4889bb01 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Updated VIF entry in instance network info cache for port 6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:10:19 user nova-compute[74889]: DEBUG nova.network.neutron [req-c77d2862-d444-402a-8bee-34d91c6f3e4a req-57bebb71-5d06-48c2-9646-4d3d4889bb01 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Updating instance_info_cache with network_info: [{"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c77d2862-d444-402a-8bee-34d91c6f3e4a req-57bebb71-5d06-48c2-9646-4d3d4889bb01 service nova] Releasing lock "refresh_cache-0cedc48f-6da1-4032-aac0-cb3961ac7c50" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:20 user nova-compute[74889]: INFO nova.compute.manager [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Terminating instance
Nov 10 12:10:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-7211ff26-94d6-4cb6-8083-8e87ad17e47b req-d8d0d404-47d8-4a1b-a8bb-cf7ffe44a2f1 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received event network-vif-unplugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7211ff26-94d6-4cb6-8083-8e87ad17e47b req-d8d0d404-47d8-4a1b-a8bb-cf7ffe44a2f1 service nova] Acquiring lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7211ff26-94d6-4cb6-8083-8e87ad17e47b req-d8d0d404-47d8-4a1b-a8bb-cf7ffe44a2f1 service nova] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7211ff26-94d6-4cb6-8083-8e87ad17e47b req-d8d0d404-47d8-4a1b-a8bb-cf7ffe44a2f1 service nova] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-7211ff26-94d6-4cb6-8083-8e87ad17e47b req-d8d0d404-47d8-4a1b-a8bb-cf7ffe44a2f1 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] No waiting events found dispatching network-vif-unplugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-7211ff26-94d6-4cb6-8083-8e87ad17e47b req-d8d0d404-47d8-4a1b-a8bb-cf7ffe44a2f1 service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received event network-vif-unplugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:10:20 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Instance destroyed successfully.
Nov 10 12:10:20 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lazy-loading 'resources' on Instance uuid 0cedc48f-6da1-4032-aac0-cb3961ac7c50 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:07:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1171665668',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1171665668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1171665668',id=32,image_ref='8f9ea443-6014-4b65-81eb-45aecdeabaa4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBYQ6Fsu9zAH/x8/1C51Qia5EQotoOGb9fesbJreISzKP2+/nxYMK0LbqkEfPEub1VD2zf4yoHdIZMgwiBSj4kX1Fop8FgQfn+3Y5TKO6lemsX3KOEZuo9qCCgOyxDEKA==',key_name='tempest-keypair-437323978',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-jkj0qjav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1577456798',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=0cedc48f-6da1-4032-aac0-cb3961ac7c50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "address": "fa:16:3e:b7:0e:c3", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a8424b5-cf", "ovs_interfaceid": "6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8424b5-cf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG os_vif [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8424b5-cf') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a8424b5-cf, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4622b4c8-bfd7-40c8-94e5-557518b01669) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:10:20 user nova-compute[74889]: INFO os_vif [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:0e:c3,bridge_name='br-int',has_traffic_filtering=True,id=6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a8424b5-cf')
Nov 10 12:10:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpuXHbea', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:10:20 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:10:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1567d7-0cc0-4631-9fba-f9c0b7cdcc7e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:20 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:10:20 user nova-compute[74889]: No targets found.
Nov 10 12:10:20 user nova-compute[74889]: iSNS:
Nov 10 12:10:20 user nova-compute[74889]: No targets found.
Nov 10 12:10:20 user nova-compute[74889]: STATIC:
Nov 10 12:10:20 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:10:20 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:10:20 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:10:20 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc
Nov 10 12:10:20 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:10:20 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:10:20 user nova-compute[74889]: FIRMWARE:
Nov 10 12:10:20 user nova-compute[74889]: No targets found.
Nov 10 12:10:20 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:10:21 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:10:21 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be4d71c-425f-4bea-9b94-b2667e4b7d7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9268920-17b5-49de-9883-476a3ef9685f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:10:21 user nova-compute[74889]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)
Nov 10 12:10:21 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:10:21 user nova-compute[74889]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc (non-flash)
Nov 10 12:10:21 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3884a3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd911537-1154-4385-9d9c-43ddb84f2502]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d382a6-8a92-4955-8dd2-99e04556e741]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba5a618-706c-46fc-bb47-53c18a8e7f2a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.073s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faa5694-b430-452d-801a-ebee82529894]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4e8f3e6e', '/dev/disk/by-id/scsi-1SCST_BIO4e8f3e6e-06cf75a55900c964', '/dev/disk/by-id/scsi-23036636637356135') {{(pid=85601) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c406f4-69e9-411a-a61f-9e2623dc66c5]: (4, None) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0430614a-72a6-4e9f-b82f-1b4a35d12b26]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7189b4f3-7bb6-4c65-b92a-6178d2871983]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc, portal: 172.16.0.220,3260]
Nov 10 12:10:21 user nova-compute[74889]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc, portal: 172.16.0.220,3260] successful.
Nov 10 12:10:21 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bf51440-df25-428e-9014-b57bbb5bf4bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0d9e65-ef6c-422d-ad73-dd4ccc7f1360]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== disconnect_volume: return (368ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:10:21 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Deleting instance files /opt/stack/data/nova/instances/0cedc48f-6da1-4032-aac0-cb3961ac7c50_del
Nov 10 12:10:21 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Deletion of /opt/stack/data/nova/instances/0cedc48f-6da1-4032-aac0-cb3961ac7c50_del complete
Nov 10 12:10:21 user nova-compute[74889]: INFO nova.compute.manager [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 10 12:10:21 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:10:21 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:10:22 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:10:22 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Took 1.36 seconds to deallocate network for instance.
Nov 10 12:10:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-45e557e2-110d-44a6-8f93-3e8a6f0fb3f9 req-24908ff8-a7ca-4a81-83fb-f0e300f71eef service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received event network-vif-deleted-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:10:22 user nova-compute[74889]: INFO nova.compute.manager [req-45e557e2-110d-44a6-8f93-3e8a6f0fb3f9 req-24908ff8-a7ca-4a81-83fb-f0e300f71eef service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Neutron deleted interface 6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d; detaching it from the instance and deleting it from the info cache
Nov 10 12:10:22 user nova-compute[74889]: DEBUG nova.network.neutron [req-45e557e2-110d-44a6-8f93-3e8a6f0fb3f9 req-24908ff8-a7ca-4a81-83fb-f0e300f71eef service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:10:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-45e557e2-110d-44a6-8f93-3e8a6f0fb3f9 req-24908ff8-a7ca-4a81-83fb-f0e300f71eef service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Detach interface failed, port_id=6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d, reason: Instance 0cedc48f-6da1-4032-aac0-cb3961ac7c50 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:10:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-b80b7f24-a341-4d9c-8072-551097729660 req-23454fc2-e823-47b2-b9a0-9631a8e57aec service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received event network-vif-plugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:10:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b80b7f24-a341-4d9c-8072-551097729660 req-23454fc2-e823-47b2-b9a0-9631a8e57aec service nova] Acquiring lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b80b7f24-a341-4d9c-8072-551097729660 req-23454fc2-e823-47b2-b9a0-9631a8e57aec service nova] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b80b7f24-a341-4d9c-8072-551097729660 req-23454fc2-e823-47b2-b9a0-9631a8e57aec service nova] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-b80b7f24-a341-4d9c-8072-551097729660 req-23454fc2-e823-47b2-b9a0-9631a8e57aec service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] No waiting events found dispatching network-vif-plugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:10:22 user nova-compute[74889]: WARNING nova.compute.manager [req-b80b7f24-a341-4d9c-8072-551097729660 req-23454fc2-e823-47b2-b9a0-9631a8e57aec service nova] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Received unexpected event network-vif-plugged-6a8424b5-cfeb-4a5c-ac33-3ff9cf08f66d for instance with vm_state active and task_state deleting.
Nov 10 12:10:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:24 user nova-compute[74889]: INFO nova.compute.manager [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Took 1.92 seconds to detach 1 volumes for instance.
Nov 10 12:10:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cedc48f-6da1-4032-aac0-cb3961ac7c50] Deleting volume: 5bf51440-df25-428e-9014-b57bbb5bf4bc {{(pid=74889) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 12:10:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:25 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:10:25 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:10:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:25 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Deleted allocations for instance 0cedc48f-6da1-4032-aac0-cb3961ac7c50
Nov 10 12:10:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ab8bf9ba-c5c5-4bd2-b58a-a9b0ec1aeb2f tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cedc48f-6da1-4032-aac0-cb3961ac7c50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.202s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "19d4137a-5cdf-42d1-8846-35813d6360f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:25 user nova-compute[74889]: INFO nova.compute.manager [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Terminating instance
Nov 10 12:10:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:10:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:26 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Instance destroyed successfully.
Nov 10 12:10:26 user nova-compute[74889]: DEBUG nova.objects.instance [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lazy-loading 'resources' on Instance uuid 19d4137a-5cdf-42d1-8846-35813d6360f6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T11:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-24504662',display_name='tempest-ServerActionsTestOtherA-server-24504662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-24504662',id=3,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHV2sPROd86lDqNq7yn/OdL+EAGi3OrNcdrVAdLzqRGaXMCeQRt25LrQ3Ql1TrND/6Dz6MBX7QNwi3U9n4Q2xTxIhGV3gbETVuDolUvGcK3ZVpcr8zuoJBqyHEchy/q4SQ==',key_name='tempest-keypair-943743287',keypairs=<?>,launch_index=0,launched_at=2023-11-10T11:50:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='688cad5e5288440bb533d6e2c2f764c1',ramdisk_id='',reservation_id='r-tnggw9ay',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-631643283',owner_user_name='tempest-ServerActionsTestOtherA-631643283-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T11:50:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f4638ca003c46dab10aab2e5a2e6fb4',uuid=19d4137a-5cdf-42d1-8846-35813d6360f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converting VIF {"id": "02539ac7-b338-4419-8c36-f8683da00cb5", "address": "fa:16:3e:cd:12:dd", "network": {"id": "7e683584-8d28-4bd3-bea1-978beaddb5af", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-894333280-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "688cad5e5288440bb533d6e2c2f764c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02539ac7-b3", "ovs_interfaceid": "02539ac7-b338-4419-8c36-f8683da00cb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:12:dd,bridge_name='br-int',has_traffic_filtering=True,id=02539ac7-b338-4419-8c36-f8683da00cb5,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02539ac7-b3') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG os_vif [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:12:dd,bridge_name='br-int',has_traffic_filtering=True,id=02539ac7-b338-4419-8c36-f8683da00cb5,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02539ac7-b3') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02539ac7-b3, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c111b159-faf3-4dfe-8390-8d1341fe7a34) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:10:26 user nova-compute[74889]: INFO os_vif [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:12:dd,bridge_name='br-int',has_traffic_filtering=True,id=02539ac7-b338-4419-8c36-f8683da00cb5,network=Network(7e683584-8d28-4bd3-bea1-978beaddb5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02539ac7-b3')
Nov 10 12:10:26 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Deleting instance files /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6_del
Nov 10 12:10:26 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Deletion of /opt/stack/data/nova/instances/19d4137a-5cdf-42d1-8846-35813d6360f6_del complete
Nov 10 12:10:26 user nova-compute[74889]: INFO nova.compute.manager [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 12:10:26 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:10:26 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-508b8d20-9a27-49f2-bf98-1236d01a7e9e req-cc4cbae3-b01c-459f-aa27-c62cb002d28c service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received event network-vif-unplugged-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-508b8d20-9a27-49f2-bf98-1236d01a7e9e req-cc4cbae3-b01c-459f-aa27-c62cb002d28c service nova] Acquiring lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-508b8d20-9a27-49f2-bf98-1236d01a7e9e req-cc4cbae3-b01c-459f-aa27-c62cb002d28c service nova] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-508b8d20-9a27-49f2-bf98-1236d01a7e9e req-cc4cbae3-b01c-459f-aa27-c62cb002d28c service nova] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-508b8d20-9a27-49f2-bf98-1236d01a7e9e req-cc4cbae3-b01c-459f-aa27-c62cb002d28c service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] No waiting events found dispatching network-vif-unplugged-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-508b8d20-9a27-49f2-bf98-1236d01a7e9e req-cc4cbae3-b01c-459f-aa27-c62cb002d28c service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received event network-vif-unplugged-02539ac7-b338-4419-8c36-f8683da00cb5 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-9ff1bf1b-a384-40af-80e6-2fb86dd7881c req-d2160da8-bc66-4172-95f1-2740777f1e53 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received event network-vif-deleted-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:10:27 user nova-compute[74889]: INFO nova.compute.manager [req-9ff1bf1b-a384-40af-80e6-2fb86dd7881c req-d2160da8-bc66-4172-95f1-2740777f1e53 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Neutron deleted interface 02539ac7-b338-4419-8c36-f8683da00cb5; detaching it from the instance and deleting it from the info cache
Nov 10 12:10:27 user nova-compute[74889]: DEBUG nova.network.neutron [req-9ff1bf1b-a384-40af-80e6-2fb86dd7881c req-d2160da8-bc66-4172-95f1-2740777f1e53 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:10:27 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Took 0.82 seconds to deallocate network for instance.
Nov 10 12:10:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-9ff1bf1b-a384-40af-80e6-2fb86dd7881c req-d2160da8-bc66-4172-95f1-2740777f1e53 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Detach interface failed, port_id=02539ac7-b338-4419-8c36-f8683da00cb5, reason: Instance 19d4137a-5cdf-42d1-8846-35813d6360f6 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:10:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:27 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Deleted allocations for instance 19d4137a-5cdf-42d1-8846-35813d6360f6
Nov 10 12:10:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-65e4cfa5-5358-4e18-aea6-406ba51253cc tempest-ServerActionsTestOtherA-631643283 tempest-ServerActionsTestOtherA-631643283-project-member] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.157s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-3ced0122-ceb3-41ea-8db0-11e14811551e req-7d9de135-6242-4250-9461-cf113891d163 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received event network-vif-plugged-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:10:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3ced0122-ceb3-41ea-8db0-11e14811551e req-7d9de135-6242-4250-9461-cf113891d163 service nova] Acquiring lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3ced0122-ceb3-41ea-8db0-11e14811551e req-7d9de135-6242-4250-9461-cf113891d163 service nova] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3ced0122-ceb3-41ea-8db0-11e14811551e req-7d9de135-6242-4250-9461-cf113891d163 service nova] Lock "19d4137a-5cdf-42d1-8846-35813d6360f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-3ced0122-ceb3-41ea-8db0-11e14811551e req-7d9de135-6242-4250-9461-cf113891d163 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] No waiting events found dispatching network-vif-plugged-02539ac7-b338-4419-8c36-f8683da00cb5 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:10:29 user nova-compute[74889]: WARNING nova.compute.manager [req-3ced0122-ceb3-41ea-8db0-11e14811551e req-7d9de135-6242-4250-9461-cf113891d163 service nova] [instance: 19d4137a-5cdf-42d1-8846-35813d6360f6] Received unexpected event network-vif-plugged-02539ac7-b338-4419-8c36-f8683da00cb5 for instance with vm_state deleted and task_state None.
Nov 10 12:10:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "14b9e652-8956-4e69-96e1-0677c49381f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "14b9e652-8956-4e69-96e1-0677c49381f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:40 user nova-compute[74889]: INFO nova.compute.manager [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Terminating instance
Nov 10 12:10:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-0f0d75d6-0734-4501-a6ea-7d44346e3e1a req-8e1a332b-e53b-4fe1-8382-58c722b81289 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received event network-vif-unplugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0f0d75d6-0734-4501-a6ea-7d44346e3e1a req-8e1a332b-e53b-4fe1-8382-58c722b81289 service nova] Acquiring lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0f0d75d6-0734-4501-a6ea-7d44346e3e1a req-8e1a332b-e53b-4fe1-8382-58c722b81289 service nova] Lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0f0d75d6-0734-4501-a6ea-7d44346e3e1a req-8e1a332b-e53b-4fe1-8382-58c722b81289 service nova] Lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-0f0d75d6-0734-4501-a6ea-7d44346e3e1a req-8e1a332b-e53b-4fe1-8382-58c722b81289 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] No waiting events found dispatching network-vif-unplugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:10:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-0f0d75d6-0734-4501-a6ea-7d44346e3e1a req-8e1a332b-e53b-4fe1-8382-58c722b81289 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received event network-vif-unplugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:10:41 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Instance destroyed successfully.
Nov 10 12:10:41 user nova-compute[74889]: DEBUG nova.objects.instance [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'resources' on Instance uuid 14b9e652-8956-4e69-96e1-0677c49381f1 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:05:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1888790662',display_name='tempest-AttachVolumeNegativeTest-server-1888790662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1888790662',id=31,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMVO1hyiGoVRGq3XnzjpCNNk3d4GAnfmGRzx7KY86YNK1sZ+d2XjHGhJS7zGF8uLDA2t9NT7Mb1n8kUsrQx0hqbjXINYrGUXcDyl6dg/q26JcPvb/YPXwOyCZiLqXV8BQ==',key_name='tempest-keypair-1720494258',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:05:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-77pheh5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=14b9e652-8956-4e69-96e1-0677c49381f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "address": "fa:16:3e:f4:a0:cd", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9db03fd1-e7", "ovs_interfaceid": "9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:a0:cd,bridge_name='br-int',has_traffic_filtering=True,id=9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db03fd1-e7') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG os_vif [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:a0:cd,bridge_name='br-int',has_traffic_filtering=True,id=9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db03fd1-e7') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9db03fd1-e7, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1010ad8-babb-4956-a791-f18eae77696d) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:10:41 user nova-compute[74889]: INFO os_vif [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:a0:cd,bridge_name='br-int',has_traffic_filtering=True,id=9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9db03fd1-e7')
Nov 10 12:10:41 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Deleting instance files /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1_del
Nov 10 12:10:41 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Deletion of /opt/stack/data/nova/instances/14b9e652-8956-4e69-96e1-0677c49381f1_del complete
Nov 10 12:10:41 user nova-compute[74889]: INFO nova.compute.manager [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 10 12:10:41 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:10:41 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:10:42 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Took 0.95 seconds to deallocate network for instance.
Nov 10 12:10:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-f929d90b-b7dd-4f6f-aba8-a0c976a42545 req-d7e20250-691c-422c-b3c3-f35e8666de0c service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received event network-vif-deleted-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:42 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Deleted allocations for instance 14b9e652-8956-4e69-96e1-0677c49381f1
Nov 10 12:10:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-078fa5d5-6841-442b-a33a-febea5883422 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "14b9e652-8956-4e69-96e1-0677c49381f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.386s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-31445c9f-581d-4582-8b2d-3ee7cda7fe8f req-e57c8f94-f4e7-41a9-a845-587c30dcc046 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received event network-vif-plugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-31445c9f-581d-4582-8b2d-3ee7cda7fe8f req-e57c8f94-f4e7-41a9-a845-587c30dcc046 service nova] Acquiring lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-31445c9f-581d-4582-8b2d-3ee7cda7fe8f req-e57c8f94-f4e7-41a9-a845-587c30dcc046 service nova] Lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-31445c9f-581d-4582-8b2d-3ee7cda7fe8f req-e57c8f94-f4e7-41a9-a845-587c30dcc046 service nova] Lock "14b9e652-8956-4e69-96e1-0677c49381f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:42 user nova-compute[74889]: DEBUG nova.compute.manager [req-31445c9f-581d-4582-8b2d-3ee7cda7fe8f req-e57c8f94-f4e7-41a9-a845-587c30dcc046 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] No waiting events found dispatching network-vif-plugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:10:42 user nova-compute[74889]: WARNING nova.compute.manager [req-31445c9f-581d-4582-8b2d-3ee7cda7fe8f req-e57c8f94-f4e7-41a9-a845-587c30dcc046 service nova] [instance: 14b9e652-8956-4e69-96e1-0677c49381f1] Received unexpected event network-vif-plugged-9db03fd1-e7f5-4b1b-8aa6-2c72b87044c3 for instance with vm_state deleted and task_state None.
Nov 10 12:10:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:46 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:10:47 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:10:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:10:50 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:10:50 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:10:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=25.507457733154297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:10:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:10:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:10:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 516ca546-b343-4d97-943d-05b975b57f79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:10:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:10:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:10:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:10:50 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:10:50 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:10:50 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:10:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:10:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:10:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:10:51 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:10:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:10:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:10:51 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:10:52 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Updating instance_info_cache with network_info: [{"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:10:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:10:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:10:52 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:10:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:10:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:10:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:10:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:11:00 user nova-compute[74889]: INFO nova.compute.claims [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Claim successful on node user
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.network.neutron [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:11:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.policy [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '109e2f18063546d48270f3ae95fae53d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a044fadd3c4420e8eedda7501a12114', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:11:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Creating image(s)
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "/opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "/opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "/opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk 1073741824" returned: 0 in 0.058s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG nova.network.neutron [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Successfully created port: ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.205s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Cannot resize image /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Ensure instance console log exists: /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Successfully updated port: ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquired lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-63d11756-0661-453d-90f1-b903b916de5a req-ddbbddfc-6cb5-40d6-a94d-cd5aab550d26 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received event network-changed-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-63d11756-0661-453d-90f1-b903b916de5a req-ddbbddfc-6cb5-40d6-a94d-cd5aab550d26 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Refreshing instance network info cache due to event network-changed-ef4d2def-ac31-49a9-af55-c5f406b80a7a. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-63d11756-0661-453d-90f1-b903b916de5a req-ddbbddfc-6cb5-40d6-a94d-cd5aab550d26 service nova] Acquiring lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Updating instance_info_cache with network_info: [{"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Releasing lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.compute.manager [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Instance network_info: |[{"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-63d11756-0661-453d-90f1-b903b916de5a req-ddbbddfc-6cb5-40d6-a94d-cd5aab550d26 service nova] Acquired lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.network.neutron [req-63d11756-0661-453d-90f1-b903b916de5a req-ddbbddfc-6cb5-40d6-a94d-cd5aab550d26 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Refreshing network info cache for port ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Start _get_guest_xml network_info=[{"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:11:02 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:11:02 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1001605610',display_name='tempest-VolumesSnapshotTestJSON-instance-1001605610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1001605610',id=33,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdu3e5E6+bpzW0z9QuVfBt71fhcnjMOHhan37/S1iP3bL+S/IR6TDAZAuQqVunHYAZfypAhjGSHJpQ87mc+cCq08SPLocnYEloFdrwnHbFiEdWSlX1KuI1hs2ZaTziyrA==',key_name='tempest-keypair-654924453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a044fadd3c4420e8eedda7501a12114',ramdisk_id='',reservation_id='r-kjgxtn87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2146398887',owner_user_name='tempest-VolumesSnapshotTestJSON-2146398887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='109e2f18063546d48270f3ae95fae53d',uuid=84d76753-0cf2-4444-a6fa-9a9500b769fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converting VIF {"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=ef4d2def-ac31-49a9-af55-c5f406b80a7a,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4d2def-ac') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.objects.instance [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lazy-loading 'pci_devices' on Instance uuid 84d76753-0cf2-4444-a6fa-9a9500b769fe {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:11:02 user nova-compute[74889]:   <uuid>84d76753-0cf2-4444-a6fa-9a9500b769fe</uuid>
Nov 10 12:11:02 user nova-compute[74889]:   <name>instance-00000021</name>
Nov 10 12:11:02 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:11:02 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:11:02 user nova-compute[74889]:   <metadata>
Nov 10 12:11:02 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:11:02 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:11:02 user nova-compute[74889]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1001605610</nova:name>
Nov 10 12:11:02 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:11:02</nova:creationTime>
Nov 10 12:11:02 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:11:02 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:11:02 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:11:02 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:11:02 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:11:02 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:11:02 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:11:02 user nova-compute[74889]:       <nova:owner>
Nov 10 12:11:02 user nova-compute[74889]:         <nova:user uuid="109e2f18063546d48270f3ae95fae53d">tempest-VolumesSnapshotTestJSON-2146398887-project-member</nova:user>
Nov 10 12:11:02 user nova-compute[74889]:         <nova:project uuid="5a044fadd3c4420e8eedda7501a12114">tempest-VolumesSnapshotTestJSON-2146398887</nova:project>
Nov 10 12:11:02 user nova-compute[74889]:       </nova:owner>
Nov 10 12:11:02 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:11:02 user nova-compute[74889]:       <nova:ports>
Nov 10 12:11:02 user nova-compute[74889]:         <nova:port uuid="ef4d2def-ac31-49a9-af55-c5f406b80a7a">
Nov 10 12:11:02 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 12:11:02 user nova-compute[74889]:         </nova:port>
Nov 10 12:11:02 user nova-compute[74889]:       </nova:ports>
Nov 10 12:11:02 user nova-compute[74889]:     </nova:instance>
Nov 10 12:11:02 user nova-compute[74889]:   </metadata>
Nov 10 12:11:02 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:11:02 user nova-compute[74889]:     <system>
Nov 10 12:11:02 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:11:02 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:11:02 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:11:02 user nova-compute[74889]:       <entry name="serial">84d76753-0cf2-4444-a6fa-9a9500b769fe</entry>
Nov 10 12:11:02 user nova-compute[74889]:       <entry name="uuid">84d76753-0cf2-4444-a6fa-9a9500b769fe</entry>
Nov 10 12:11:02 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:11:02 user nova-compute[74889]:     </system>
Nov 10 12:11:02 user nova-compute[74889]:   </sysinfo>
Nov 10 12:11:02 user nova-compute[74889]:   <os>
Nov 10 12:11:02 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:11:02 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:11:02 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:11:02 user nova-compute[74889]:   </os>
Nov 10 12:11:02 user nova-compute[74889]:   <features>
Nov 10 12:11:02 user nova-compute[74889]:     <acpi/>
Nov 10 12:11:02 user nova-compute[74889]:     <apic/>
Nov 10 12:11:02 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:11:02 user nova-compute[74889]:   </features>
Nov 10 12:11:02 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:11:02 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:11:02 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:11:02 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:11:02 user nova-compute[74889]:   </clock>
Nov 10 12:11:02 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:11:02 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:11:02 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:11:02 user nova-compute[74889]:   </cpu>
Nov 10 12:11:02 user nova-compute[74889]:   <devices>
Nov 10 12:11:02 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:11:02 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:11:02 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk"/>
Nov 10 12:11:02 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:11:02 user nova-compute[74889]:     </disk>
Nov 10 12:11:02 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:11:02 user nova-compute[74889]:       <mac address="fa:16:3e:46:e7:68"/>
Nov 10 12:11:02 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:11:02 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:11:02 user nova-compute[74889]:       <target dev="tapef4d2def-ac"/>
Nov 10 12:11:02 user nova-compute[74889]:     </interface>
Nov 10 12:11:02 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:11:02 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/console.log" append="off"/>
Nov 10 12:11:02 user nova-compute[74889]:     </serial>
Nov 10 12:11:02 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:11:02 user nova-compute[74889]:     <video>
Nov 10 12:11:02 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:11:02 user nova-compute[74889]:     </video>
Nov 10 12:11:02 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:11:02 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:11:02 user nova-compute[74889]:     </rng>
Nov 10 12:11:02 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:11:02 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:11:02 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:11:02 user nova-compute[74889]:     </memballoon>
Nov 10 12:11:02 user nova-compute[74889]:   </devices>
Nov 10 12:11:02 user nova-compute[74889]: </domain>
Nov 10 12:11:02 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1001605610',display_name='tempest-VolumesSnapshotTestJSON-instance-1001605610',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1001605610',id=33,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdu3e5E6+bpzW0z9QuVfBt71fhcnjMOHhan37/S1iP3bL+S/IR6TDAZAuQqVunHYAZfypAhjGSHJpQ87mc+cCq08SPLocnYEloFdrwnHbFiEdWSlX1KuI1hs2ZaTziyrA==',key_name='tempest-keypair-654924453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a044fadd3c4420e8eedda7501a12114',ramdisk_id='',reservation_id='r-kjgxtn87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2146398887',owner_user_name='tempest-VolumesSnapshotTestJSON-2146398887-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='109e2f18063546d48270f3ae95fae53d',uuid=84d76753-0cf2-4444-a6fa-9a9500b769fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converting VIF {"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=ef4d2def-ac31-49a9-af55-c5f406b80a7a,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4d2def-ac') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG os_vif [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=ef4d2def-ac31-49a9-af55-c5f406b80a7a,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4d2def-ac') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28957e20-067e-568a-8acd-b486aa746e76', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef4d2def-ac, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef4d2def-ac, col_values=(('qos', UUID('7423bdf2-f8cc-4896-afe2-1f9df9d80f18')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef4d2def-ac, col_values=(('external_ids', {'iface-id': 'ef4d2def-ac31-49a9-af55-c5f406b80a7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:e7:68', 'vm-uuid': '84d76753-0cf2-4444-a6fa-9a9500b769fe'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:02 user nova-compute[74889]: INFO os_vif [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=ef4d2def-ac31-49a9-af55-c5f406b80a7a,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4d2def-ac')
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:11:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] No VIF found with MAC fa:16:3e:46:e7:68, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:11:03 user nova-compute[74889]: DEBUG nova.network.neutron [req-63d11756-0661-453d-90f1-b903b916de5a req-ddbbddfc-6cb5-40d6-a94d-cd5aab550d26 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Updated VIF entry in instance network info cache for port ef4d2def-ac31-49a9-af55-c5f406b80a7a. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:11:03 user nova-compute[74889]: DEBUG nova.network.neutron [req-63d11756-0661-453d-90f1-b903b916de5a req-ddbbddfc-6cb5-40d6-a94d-cd5aab550d26 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Updating instance_info_cache with network_info: [{"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-63d11756-0661-453d-90f1-b903b916de5a req-ddbbddfc-6cb5-40d6-a94d-cd5aab550d26 service nova] Releasing lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-3bdddffc-e98e-4852-8041-4a97b2213b73 req-a1825b37-82bb-44df-9540-e7b09b0b1b2b service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received event network-vif-plugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3bdddffc-e98e-4852-8041-4a97b2213b73 req-a1825b37-82bb-44df-9540-e7b09b0b1b2b service nova] Acquiring lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3bdddffc-e98e-4852-8041-4a97b2213b73 req-a1825b37-82bb-44df-9540-e7b09b0b1b2b service nova] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3bdddffc-e98e-4852-8041-4a97b2213b73 req-a1825b37-82bb-44df-9540-e7b09b0b1b2b service nova] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-3bdddffc-e98e-4852-8041-4a97b2213b73 req-a1825b37-82bb-44df-9540-e7b09b0b1b2b service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] No waiting events found dispatching network-vif-plugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:04 user nova-compute[74889]: WARNING nova.compute.manager [req-3bdddffc-e98e-4852-8041-4a97b2213b73 req-a1825b37-82bb-44df-9540-e7b09b0b1b2b service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received unexpected event network-vif-plugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a for instance with vm_state building and task_state spawning.
Nov 10 12:11:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:11:06 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Instance spawned successfully.
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-545fd06f-74fa-4d20-af20-9edb109b5d76 req-59e75b9e-fc5c-4c9a-a33c-d36376241e37 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received event network-vif-plugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-545fd06f-74fa-4d20-af20-9edb109b5d76 req-59e75b9e-fc5c-4c9a-a33c-d36376241e37 service nova] Acquiring lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-545fd06f-74fa-4d20-af20-9edb109b5d76 req-59e75b9e-fc5c-4c9a-a33c-d36376241e37 service nova] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-545fd06f-74fa-4d20-af20-9edb109b5d76 req-59e75b9e-fc5c-4c9a-a33c-d36376241e37 service nova] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-545fd06f-74fa-4d20-af20-9edb109b5d76 req-59e75b9e-fc5c-4c9a-a33c-d36376241e37 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] No waiting events found dispatching network-vif-plugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:06 user nova-compute[74889]: WARNING nova.compute.manager [req-545fd06f-74fa-4d20-af20-9edb109b5d76 req-59e75b9e-fc5c-4c9a-a33c-d36376241e37 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received unexpected event network-vif-plugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a for instance with vm_state building and task_state spawning.
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:06 user nova-compute[74889]: INFO nova.compute.manager [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 10 12:11:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:11:07 user nova-compute[74889]: INFO nova.compute.manager [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Took 6.74 seconds to build instance.
Nov 10 12:11:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-297cb78d-12c9-4233-9958-af42dc68d603 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.860s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:22 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:11:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:22 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:11:22 user nova-compute[74889]: INFO nova.compute.claims [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Claim successful on node user
Nov 10 12:11:23 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:11:23 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:11:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:23 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:11:23 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:11:23 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:11:23 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:11:23 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:11:23 user nova-compute[74889]: DEBUG nova.policy [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '627e26b7a67f41dabc010d18327219d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44f81df6b2364ab4a0f6577d58aeb413', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:11:23 user nova-compute[74889]: INFO nova.virt.block_device [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Booting with volume 24ed6795-3545-4675-8826-e2cec2254d42 at /dev/vda
Nov 10 12:11:23 user nova-compute[74889]: DEBUG os_brick.utils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:11:23 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19dc229-1a0b-44db-9e70-df6a2467c172]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[523bf6d1-82f5-4a0f-98f8-205ff3c95698]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd28a11d-2181-4d39-87e2-0b947560934b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac0a27c-68ce-475b-8b0f-cd52ad9d1f86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:11:24 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:11:24 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[af60e2bb-d56e-496d-a922-082e0fcc8720]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG os_brick.utils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating existing volume attachment record: 6fc4e47e-5889-4eb3-9046-f47816b34017 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:24 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully created port: c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:11:25 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully created port: d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:11:25 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully created port: 65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:11:26 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully created port: 57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:11:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully created port: ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:11:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:28 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully updated port: c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:11:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-945f7c10-d9db-4402-8ae8-243f5f11b1e9 req-70d14af4-2105-4f48-96b9-d24229adc2ee service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-changed-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-945f7c10-d9db-4402-8ae8-243f5f11b1e9 req-70d14af4-2105-4f48-96b9-d24229adc2ee service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing instance network info cache due to event network-changed-c48dd5ca-ff1b-43d2-aa2b-28876a27b698. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:11:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-945f7c10-d9db-4402-8ae8-243f5f11b1e9 req-70d14af4-2105-4f48-96b9-d24229adc2ee service nova] Acquiring lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-945f7c10-d9db-4402-8ae8-243f5f11b1e9 req-70d14af4-2105-4f48-96b9-d24229adc2ee service nova] Acquired lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-945f7c10-d9db-4402-8ae8-243f5f11b1e9 req-70d14af4-2105-4f48-96b9-d24229adc2ee service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing network info cache for port c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:11:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-945f7c10-d9db-4402-8ae8-243f5f11b1e9 req-70d14af4-2105-4f48-96b9-d24229adc2ee service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:11:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-945f7c10-d9db-4402-8ae8-243f5f11b1e9 req-70d14af4-2105-4f48-96b9-d24229adc2ee service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-945f7c10-d9db-4402-8ae8-243f5f11b1e9 req-70d14af4-2105-4f48-96b9-d24229adc2ee service nova] Releasing lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:29 user nova-compute[74889]: INFO nova.compute.manager [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Terminating instance
Nov 10 12:11:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:11:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully updated port: ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-59abdd51-a89d-44a6-b8e7-7885323d7786 req-0d2cdc97-05d9-4d30-a57f-c8a947ec7973 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-changed-ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-59abdd51-a89d-44a6-b8e7-7885323d7786 req-0d2cdc97-05d9-4d30-a57f-c8a947ec7973 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing instance network info cache due to event network-changed-ad634c53-9335-4a00-8976-d6f66f2462fc. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-59abdd51-a89d-44a6-b8e7-7885323d7786 req-0d2cdc97-05d9-4d30-a57f-c8a947ec7973 service nova] Acquiring lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-59abdd51-a89d-44a6-b8e7-7885323d7786 req-0d2cdc97-05d9-4d30-a57f-c8a947ec7973 service nova] Acquired lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG nova.network.neutron [req-59abdd51-a89d-44a6-b8e7-7885323d7786 req-0d2cdc97-05d9-4d30-a57f-c8a947ec7973 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing network info cache for port ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Instance destroyed successfully.
Nov 10 12:11:30 user nova-compute[74889]: DEBUG nova.objects.instance [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lazy-loading 'resources' on Instance uuid 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:05:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-414501121',display_name='tempest-TestVolumeBootPattern-volume-backed-server-414501121',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-414501121',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApwhofCLbU4Sp4Fsx1xBuM107AQwjVPzFnvvXXi7l5q3yl8qq+VcB4PiHnjcnTj4HW+6e0/mA9RK7SDUBmtzbdax9K0wUQKup/OPIs98MdomgtgfzR8gSsoYq9SjYPbWw==',key_name='tempest-keypair-1691904880',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:05:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-snhjp70j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "999a321c-2987-4a20-8414-da97331a6a9d", "address": "fa:16:3e:dd:68:83", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap999a321c-29", "ovs_interfaceid": "999a321c-2987-4a20-8414-da97331a6a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:68:83,bridge_name='br-int',has_traffic_filtering=True,id=999a321c-2987-4a20-8414-da97331a6a9d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999a321c-29') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_vif [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:68:83,bridge_name='br-int',has_traffic_filtering=True,id=999a321c-2987-4a20-8414-da97331a6a9d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999a321c-29') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap999a321c-29, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eadaf01a-9c44-46cf-b0cc-70e80f26be3f) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:11:30 user nova-compute[74889]: INFO os_vif [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:68:83,bridge_name='br-int',has_traffic_filtering=True,id=999a321c-2987-4a20-8414-da97331a6a9d,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap999a321c-29')
Nov 10 12:11:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'txAzlibn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:11:30 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[973738e0-5629-4cff-bd7f-937c903456fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:11:30 user nova-compute[74889]: No targets found.
Nov 10 12:11:30 user nova-compute[74889]: iSNS:
Nov 10 12:11:30 user nova-compute[74889]: No targets found.
Nov 10 12:11:30 user nova-compute[74889]: STATIC:
Nov 10 12:11:30 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147
Nov 10 12:11:30 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:11:30 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:11:30 user nova-compute[74889]: FIRMWARE:
Nov 10 12:11:30 user nova-compute[74889]: No targets found.
Nov 10 12:11:30 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:11:30 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:11:30 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG nova.network.neutron [req-59abdd51-a89d-44a6-b8e7-7885323d7786 req-0d2cdc97-05d9-4d30-a57f-c8a947ec7973 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[720db772-d821-4727-b3af-51a52cdbb205]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5561e56e-e8d7-4101-836a-316331a5b67e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:11:30 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 (non-flash)
Nov 10 12:11:30 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3884a0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147'): ({'sde'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Removing single pathed devices sde {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.063s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3906dcb0-dc6f-4504-95bf-2a8ac85ec2b3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ee8898-ba62-421b-a43b-aff01677c039]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flushing IO for device /dev/sde {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4afeb06-ceb9-4c23-a1ff-3b5ede522f1e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-a73abbbd-8222-4ab2-981b-00878ca6e98c req-660426e3-c790-4204-9022-6e41ddb036d4 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-unplugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a73abbbd-8222-4ab2-981b-00878ca6e98c req-660426e3-c790-4204-9022-6e41ddb036d4 service nova] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a73abbbd-8222-4ab2-981b-00878ca6e98c req-660426e3-c790-4204-9022-6e41ddb036d4 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a73abbbd-8222-4ab2-981b-00878ca6e98c req-660426e3-c790-4204-9022-6e41ddb036d4 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-a73abbbd-8222-4ab2-981b-00878ca6e98c req-660426e3-c790-4204-9022-6e41ddb036d4 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] No waiting events found dispatching network-vif-unplugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-a73abbbd-8222-4ab2-981b-00878ca6e98c req-660426e3-c790-4204-9022-6e41ddb036d4 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-unplugged-999a321c-2987-4a20-8414-da97331a6a9d for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.146s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9ceb26-2a5f-45b5-844f-7768df1def1b]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_aa350e55', '/dev/disk/by-id/scsi-1SCST_BIOaa350e55-6282f4fa85a45f3d', '/dev/disk/by-id/scsi-23632383266346661') {{(pid=85601) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b518c7-85c6-4152-99f9-3c0cf2f4e2c3]: (4, None) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad63feaa-a46c-4ce9-b098-9d000ea585cb]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f75a6b-16ca-4866-8255-fe51dfa960d5]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147, portal: 172.16.0.220,3260]
Nov 10 12:11:31 user nova-compute[74889]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147, portal: 172.16.0.220,3260] successful.
Nov 10 12:11:31 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9e012f6-ebd0-4c52-a368-c65b82b54147 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eda60f-3ba1-4a04-bbfc-62be741c59b8]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.562s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== disconnect_volume: return (563ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:11:31 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Deleting instance files /opt/stack/data/nova/instances/0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb_del
Nov 10 12:11:31 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Deletion of /opt/stack/data/nova/instances/0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb_del complete
Nov 10 12:11:31 user nova-compute[74889]: INFO nova.compute.manager [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-59abdd51-a89d-44a6-b8e7-7885323d7786 req-0d2cdc97-05d9-4d30-a57f-c8a947ec7973 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-59abdd51-a89d-44a6-b8e7-7885323d7786 req-0d2cdc97-05d9-4d30-a57f-c8a947ec7973 service nova] Releasing lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully updated port: bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-e10d59d2-3ae5-4fbe-8e27-346d11e9aacd req-88b62ae7-67cf-45a0-833e-e940b564ffc3 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-changed-bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-e10d59d2-3ae5-4fbe-8e27-346d11e9aacd req-88b62ae7-67cf-45a0-833e-e940b564ffc3 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing instance network info cache due to event network-changed-bd0d21a9-d10e-4de0-9348-74adff8baad3. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e10d59d2-3ae5-4fbe-8e27-346d11e9aacd req-88b62ae7-67cf-45a0-833e-e940b564ffc3 service nova] Acquiring lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e10d59d2-3ae5-4fbe-8e27-346d11e9aacd req-88b62ae7-67cf-45a0-833e-e940b564ffc3 service nova] Acquired lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-e10d59d2-3ae5-4fbe-8e27-346d11e9aacd req-88b62ae7-67cf-45a0-833e-e940b564ffc3 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing network info cache for port bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully updated port: d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:11:32 user nova-compute[74889]: INFO nova.compute.claims [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Claim successful on node user
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-e10d59d2-3ae5-4fbe-8e27-346d11e9aacd req-88b62ae7-67cf-45a0-833e-e940b564ffc3 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:32 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Took 1.34 seconds to deallocate network for instance.
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.compute.manager [req-e4da0256-57e2-47ba-9601-9fb344ddf0b9 req-785421d9-60a8-46aa-9496-88f16336f182 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-deleted-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.network.neutron [req-e10d59d2-3ae5-4fbe-8e27-346d11e9aacd req-88b62ae7-67cf-45a0-833e-e940b564ffc3 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e10d59d2-3ae5-4fbe-8e27-346d11e9aacd req-88b62ae7-67cf-45a0-833e-e940b564ffc3 service nova] Releasing lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:11:32 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:11:33 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.policy [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c2a48cfc9e04a2dbd2ad51b70c8b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757eef88e9c04404a1ddedfa23b6031d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] No waiting events found dispatching network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:33 user nova-compute[74889]: WARNING nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received unexpected event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d for instance with vm_state active and task_state deleting.
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] No waiting events found dispatching network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:33 user nova-compute[74889]: WARNING nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received unexpected event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d for instance with vm_state active and task_state deleting.
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] No waiting events found dispatching network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:33 user nova-compute[74889]: WARNING nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received unexpected event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d for instance with vm_state active and task_state deleting.
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-unplugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] No waiting events found dispatching network-vif-unplugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-unplugged-999a321c-2987-4a20-8414-da97331a6a9d for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Acquiring lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] No waiting events found dispatching network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:33 user nova-compute[74889]: WARNING nova.compute.manager [req-d3e40d3d-2c44-4184-a1fa-08f80d2b31d1 req-acf17227-f43a-49ad-bc82-a69a94177a05 service nova] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Received unexpected event network-vif-plugged-999a321c-2987-4a20-8414-da97331a6a9d for instance with vm_state active and task_state deleting.
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:11:33 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Creating image(s)
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "/opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "/opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "/opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.027s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.217s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully updated port: 65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk 1073741824" returned: 0 in 0.067s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.233s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Successfully created port: f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Cannot resize image /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Ensure instance console log exists: /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-b71c31d7-0821-4eef-85b6-eedd3d795057 req-dfa0da48-9c92-499f-ae80-e38656c1c5ba service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-changed-d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-b71c31d7-0821-4eef-85b6-eedd3d795057 req-dfa0da48-9c92-499f-ae80-e38656c1c5ba service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing instance network info cache due to event network-changed-d36952a8-d18b-4234-9829-3160f2e1882e. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b71c31d7-0821-4eef-85b6-eedd3d795057 req-dfa0da48-9c92-499f-ae80-e38656c1c5ba service nova] Acquiring lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b71c31d7-0821-4eef-85b6-eedd3d795057 req-dfa0da48-9c92-499f-ae80-e38656c1c5ba service nova] Acquired lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG nova.network.neutron [req-b71c31d7-0821-4eef-85b6-eedd3d795057 req-dfa0da48-9c92-499f-ae80-e38656c1c5ba service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing network info cache for port d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG nova.network.neutron [req-b71c31d7-0821-4eef-85b6-eedd3d795057 req-dfa0da48-9c92-499f-ae80-e38656c1c5ba service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:11:34 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully updated port: 57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-b71c31d7-0821-4eef-85b6-eedd3d795057 req-dfa0da48-9c92-499f-ae80-e38656c1c5ba service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b71c31d7-0821-4eef-85b6-eedd3d795057 req-dfa0da48-9c92-499f-ae80-e38656c1c5ba service nova] Releasing lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-changed-65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing instance network info cache due to event network-changed-65117c96-c353-458c-9df6-48237186ca2d. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] Acquiring lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] Acquired lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing network info cache for port 65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Successfully updated port: ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] Releasing lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-changed-57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing instance network info cache due to event network-changed-57ea1ebe-c6fa-4cee-9718-db0369133dc2. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] Acquiring lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] Acquired lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing network info cache for port 57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Successfully updated port: f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquired lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:35 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.network.neutron [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c405830b-534d-49d9-ba3d-e8d966a8bc7f req-03a5de50-d9a5-4155-a6cc-c4d642535903 service nova] Releasing lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquired lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updating instance_info_cache with network_info: [{"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Releasing lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Instance network_info: |[{"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Start _get_guest_xml network_info=[{"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:11:36 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:11:36 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-592346711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-592346711',id=35,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-nhdc88ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:33Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=662a3c8c-e0b0-4dea-b620-d11de1c5a92e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:06:48,bridge_name='br-int',has_traffic_filtering=True,id=f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19c2cc5-bf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'pci_devices' on Instance uuid 662a3c8c-e0b0-4dea-b620-d11de1c5a92e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:11:36 user nova-compute[74889]:   <uuid>662a3c8c-e0b0-4dea-b620-d11de1c5a92e</uuid>
Nov 10 12:11:36 user nova-compute[74889]:   <name>instance-00000023</name>
Nov 10 12:11:36 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:11:36 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:11:36 user nova-compute[74889]:   <metadata>
Nov 10 12:11:36 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:11:36 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:11:36 user nova-compute[74889]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-592346711</nova:name>
Nov 10 12:11:36 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:11:36</nova:creationTime>
Nov 10 12:11:36 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:11:36 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:11:36 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:11:36 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:11:36 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:11:36 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:11:36 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:11:36 user nova-compute[74889]:       <nova:owner>
Nov 10 12:11:36 user nova-compute[74889]:         <nova:user uuid="4c2a48cfc9e04a2dbd2ad51b70c8b114">tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member</nova:user>
Nov 10 12:11:36 user nova-compute[74889]:         <nova:project uuid="757eef88e9c04404a1ddedfa23b6031d">tempest-ServerBootFromVolumeStableRescueTest-1484079705</nova:project>
Nov 10 12:11:36 user nova-compute[74889]:       </nova:owner>
Nov 10 12:11:36 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:11:36 user nova-compute[74889]:       <nova:ports>
Nov 10 12:11:36 user nova-compute[74889]:         <nova:port uuid="f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065">
Nov 10 12:11:36 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 12:11:36 user nova-compute[74889]:         </nova:port>
Nov 10 12:11:36 user nova-compute[74889]:       </nova:ports>
Nov 10 12:11:36 user nova-compute[74889]:     </nova:instance>
Nov 10 12:11:36 user nova-compute[74889]:   </metadata>
Nov 10 12:11:36 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:11:36 user nova-compute[74889]:     <system>
Nov 10 12:11:36 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:11:36 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:11:36 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:11:36 user nova-compute[74889]:       <entry name="serial">662a3c8c-e0b0-4dea-b620-d11de1c5a92e</entry>
Nov 10 12:11:36 user nova-compute[74889]:       <entry name="uuid">662a3c8c-e0b0-4dea-b620-d11de1c5a92e</entry>
Nov 10 12:11:36 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:11:36 user nova-compute[74889]:     </system>
Nov 10 12:11:36 user nova-compute[74889]:   </sysinfo>
Nov 10 12:11:36 user nova-compute[74889]:   <os>
Nov 10 12:11:36 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:11:36 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:11:36 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:11:36 user nova-compute[74889]:   </os>
Nov 10 12:11:36 user nova-compute[74889]:   <features>
Nov 10 12:11:36 user nova-compute[74889]:     <acpi/>
Nov 10 12:11:36 user nova-compute[74889]:     <apic/>
Nov 10 12:11:36 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:11:36 user nova-compute[74889]:   </features>
Nov 10 12:11:36 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:11:36 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:11:36 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:11:36 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:11:36 user nova-compute[74889]:   </clock>
Nov 10 12:11:36 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:11:36 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:11:36 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:11:36 user nova-compute[74889]:   </cpu>
Nov 10 12:11:36 user nova-compute[74889]:   <devices>
Nov 10 12:11:36 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:11:36 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:11:36 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk"/>
Nov 10 12:11:36 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:11:36 user nova-compute[74889]:     </disk>
Nov 10 12:11:36 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:11:36 user nova-compute[74889]:       <mac address="fa:16:3e:82:06:48"/>
Nov 10 12:11:36 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:11:36 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:11:36 user nova-compute[74889]:       <target dev="tapf19c2cc5-bf"/>
Nov 10 12:11:36 user nova-compute[74889]:     </interface>
Nov 10 12:11:36 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:11:36 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/console.log" append="off"/>
Nov 10 12:11:36 user nova-compute[74889]:     </serial>
Nov 10 12:11:36 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:11:36 user nova-compute[74889]:     <video>
Nov 10 12:11:36 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:11:36 user nova-compute[74889]:     </video>
Nov 10 12:11:36 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:11:36 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:11:36 user nova-compute[74889]:     </rng>
Nov 10 12:11:36 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:11:36 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:11:36 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:11:36 user nova-compute[74889]:     </memballoon>
Nov 10 12:11:36 user nova-compute[74889]:   </devices>
Nov 10 12:11:36 user nova-compute[74889]: </domain>
Nov 10 12:11:36 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-592346711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-592346711',id=35,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-nhdc88ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:33Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=662a3c8c-e0b0-4dea-b620-d11de1c5a92e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:06:48,bridge_name='br-int',has_traffic_filtering=True,id=f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19c2cc5-bf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG os_vif [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:06:48,bridge_name='br-int',has_traffic_filtering=True,id=f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19c2cc5-bf') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee090e34-31e6-5ec4-b35b-37e0b26515c4', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf19c2cc5-bf, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf19c2cc5-bf, col_values=(('qos', UUID('4f287e9b-4fed-41a8-8962-0133a9ff20c2')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf19c2cc5-bf, col_values=(('external_ids', {'iface-id': 'f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:06:48', 'vm-uuid': '662a3c8c-e0b0-4dea-b620-d11de1c5a92e'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:36 user nova-compute[74889]: INFO os_vif [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:06:48,bridge_name='br-int',has_traffic_filtering=True,id=f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19c2cc5-bf')
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No VIF found with MAC fa:16:3e:82:06:48, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-48c11ba5-02d9-4f6d-a935-58ef12aa8c1d req-a9d7aaec-2521-49c1-9022-5efe8e166d0f service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-changed-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-48c11ba5-02d9-4f6d-a935-58ef12aa8c1d req-a9d7aaec-2521-49c1-9022-5efe8e166d0f service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Refreshing instance network info cache due to event network-changed-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-48c11ba5-02d9-4f6d-a935-58ef12aa8c1d req-a9d7aaec-2521-49c1-9022-5efe8e166d0f service nova] Acquiring lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-48c11ba5-02d9-4f6d-a935-58ef12aa8c1d req-a9d7aaec-2521-49c1-9022-5efe8e166d0f service nova] Acquired lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.network.neutron [req-48c11ba5-02d9-4f6d-a935-58ef12aa8c1d req-a9d7aaec-2521-49c1-9022-5efe8e166d0f service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Refreshing network info cache for port f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "dd45343e-ffad-435a-83da-ad9c64fba838" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:11:37 user nova-compute[74889]: INFO nova.compute.claims [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Claim successful on node user
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.network.neutron [req-48c11ba5-02d9-4f6d-a935-58ef12aa8c1d req-a9d7aaec-2521-49c1-9022-5efe8e166d0f service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updated VIF entry in instance network info cache for port f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.network.neutron [req-48c11ba5-02d9-4f6d-a935-58ef12aa8c1d req-a9d7aaec-2521-49c1-9022-5efe8e166d0f service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updating instance_info_cache with network_info: [{"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-48c11ba5-02d9-4f6d-a935-58ef12aa8c1d req-a9d7aaec-2521-49c1-9022-5efe8e166d0f service nova] Releasing lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-6621a1a9-372d-4542-bdca-e41d3fa94d60 req-bacfe4f1-baad-492b-9bde-627cda2b53f2 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-changed-ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-6621a1a9-372d-4542-bdca-e41d3fa94d60 req-bacfe4f1-baad-492b-9bde-627cda2b53f2 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing instance network info cache due to event network-changed-ccd32963-90a4-40ee-8d7e-e9896a20483c. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6621a1a9-372d-4542-bdca-e41d3fa94d60 req-bacfe4f1-baad-492b-9bde-627cda2b53f2 service nova] Acquiring lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.network.neutron [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:11:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.policy [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3485bf67f27e4b72868b0adc1225bfeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80c6ad4f23d94494b3f42cdbc7fd4516', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.compute.manager [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:11:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Creating image(s)
Nov 10 12:11:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "/opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "/opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.242s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.226s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk 1073741824" returned: 0 in 0.090s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.232s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [{"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Releasing lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance network_info: |[{"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6621a1a9-372d-4542-bdca-e41d3fa94d60 req-bacfe4f1-baad-492b-9bde-627cda2b53f2 service nova] Acquired lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.network.neutron [req-6621a1a9-372d-4542-bdca-e41d3fa94d60 req-bacfe4f1-baad-492b-9bde-627cda2b53f2 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing network info cache for port ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.network.neutron [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Successfully created port: 1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] No waiting events found dispatching network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:38 user nova-compute[74889]: WARNING nova.compute.manager [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received unexpected event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 for instance with vm_state building and task_state spawning.
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] No waiting events found dispatching network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:38 user nova-compute[74889]: WARNING nova.compute.manager [req-557840fd-3585-4aa4-a69c-bf1948ba5c4f req-5f446b6a-915f-46ad-bd7c-13e9aac096c4 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received unexpected event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 for instance with vm_state building and task_state spawning.
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Cannot resize image /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Ensure instance console log exists: /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.network.neutron [req-6621a1a9-372d-4542-bdca-e41d3fa94d60 req-bacfe4f1-baad-492b-9bde-627cda2b53f2 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updated VIF entry in instance network info cache for port ccd32963-90a4-40ee-8d7e-e9896a20483c. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.network.neutron [req-6621a1a9-372d-4542-bdca-e41d3fa94d60 req-bacfe4f1-baad-492b-9bde-627cda2b53f2 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [{"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6621a1a9-372d-4542-bdca-e41d3fa94d60 req-bacfe4f1-baad-492b-9bde-627cda2b53f2 service nova] Releasing lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Successfully updated port: 1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquired lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.network.neutron [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Updating instance_info_cache with network_info: [{"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Releasing lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Instance network_info: |[{"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Start _get_guest_xml network_info=[{"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:11:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874173005',display_name='tempest-AttachVolumeNegativeTest-server-874173005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874173005',id=36,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/3R8S9hWvc5dnECaekK2OppGBz8/dWPeHBlY3gYVcnTHA/3wNxDprLSuMSULzS+SPkmLjNZ2a86G+d7AZ9MYPH71PLoTMcs8ytsdXcFPN1piF+W/NVYS0Ehlf1BNuTrw==',key_name='tempest-keypair-1952883171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-637yl0h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=dd45343e-ffad-435a-83da-ad9c64fba838,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:79:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f832d39-3dac-4a72-ae5c-9ba95cd55983,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f832d39-3d') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'pci_devices' on Instance uuid dd45343e-ffad-435a-83da-ad9c64fba838 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:11:39 user nova-compute[74889]:   <uuid>dd45343e-ffad-435a-83da-ad9c64fba838</uuid>
Nov 10 12:11:39 user nova-compute[74889]:   <name>instance-00000024</name>
Nov 10 12:11:39 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:11:39 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:11:39 user nova-compute[74889]:   <metadata>
Nov 10 12:11:39 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:11:39 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:11:39 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeNegativeTest-server-874173005</nova:name>
Nov 10 12:11:39 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:11:39</nova:creationTime>
Nov 10 12:11:39 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:11:39 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:11:39 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:11:39 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:11:39 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:11:39 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:11:39 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:11:39 user nova-compute[74889]:       <nova:owner>
Nov 10 12:11:39 user nova-compute[74889]:         <nova:user uuid="3485bf67f27e4b72868b0adc1225bfeb">tempest-AttachVolumeNegativeTest-238498304-project-member</nova:user>
Nov 10 12:11:39 user nova-compute[74889]:         <nova:project uuid="80c6ad4f23d94494b3f42cdbc7fd4516">tempest-AttachVolumeNegativeTest-238498304</nova:project>
Nov 10 12:11:39 user nova-compute[74889]:       </nova:owner>
Nov 10 12:11:39 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:11:39 user nova-compute[74889]:       <nova:ports>
Nov 10 12:11:39 user nova-compute[74889]:         <nova:port uuid="1f832d39-3dac-4a72-ae5c-9ba95cd55983">
Nov 10 12:11:39 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 12:11:39 user nova-compute[74889]:         </nova:port>
Nov 10 12:11:39 user nova-compute[74889]:       </nova:ports>
Nov 10 12:11:39 user nova-compute[74889]:     </nova:instance>
Nov 10 12:11:39 user nova-compute[74889]:   </metadata>
Nov 10 12:11:39 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:11:39 user nova-compute[74889]:     <system>
Nov 10 12:11:39 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:11:39 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:11:39 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:11:39 user nova-compute[74889]:       <entry name="serial">dd45343e-ffad-435a-83da-ad9c64fba838</entry>
Nov 10 12:11:39 user nova-compute[74889]:       <entry name="uuid">dd45343e-ffad-435a-83da-ad9c64fba838</entry>
Nov 10 12:11:39 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:11:39 user nova-compute[74889]:     </system>
Nov 10 12:11:39 user nova-compute[74889]:   </sysinfo>
Nov 10 12:11:39 user nova-compute[74889]:   <os>
Nov 10 12:11:39 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:11:39 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:11:39 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:11:39 user nova-compute[74889]:   </os>
Nov 10 12:11:39 user nova-compute[74889]:   <features>
Nov 10 12:11:39 user nova-compute[74889]:     <acpi/>
Nov 10 12:11:39 user nova-compute[74889]:     <apic/>
Nov 10 12:11:39 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:11:39 user nova-compute[74889]:   </features>
Nov 10 12:11:39 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:11:39 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:11:39 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:11:39 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:11:39 user nova-compute[74889]:   </clock>
Nov 10 12:11:39 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:11:39 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:11:39 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:11:39 user nova-compute[74889]:   </cpu>
Nov 10 12:11:39 user nova-compute[74889]:   <devices>
Nov 10 12:11:39 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:11:39 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:11:39 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk"/>
Nov 10 12:11:39 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:11:39 user nova-compute[74889]:     </disk>
Nov 10 12:11:39 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:11:39 user nova-compute[74889]:       <mac address="fa:16:3e:34:79:6f"/>
Nov 10 12:11:39 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:11:39 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:11:39 user nova-compute[74889]:       <target dev="tap1f832d39-3d"/>
Nov 10 12:11:39 user nova-compute[74889]:     </interface>
Nov 10 12:11:39 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:11:39 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/console.log" append="off"/>
Nov 10 12:11:39 user nova-compute[74889]:     </serial>
Nov 10 12:11:39 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:11:39 user nova-compute[74889]:     <video>
Nov 10 12:11:39 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:11:39 user nova-compute[74889]:     </video>
Nov 10 12:11:39 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:11:39 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:11:39 user nova-compute[74889]:     </rng>
Nov 10 12:11:39 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:11:39 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:11:39 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:11:39 user nova-compute[74889]:     </memballoon>
Nov 10 12:11:39 user nova-compute[74889]:   </devices>
Nov 10 12:11:39 user nova-compute[74889]: </domain>
Nov 10 12:11:39 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874173005',display_name='tempest-AttachVolumeNegativeTest-server-874173005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874173005',id=36,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/3R8S9hWvc5dnECaekK2OppGBz8/dWPeHBlY3gYVcnTHA/3wNxDprLSuMSULzS+SPkmLjNZ2a86G+d7AZ9MYPH71PLoTMcs8ytsdXcFPN1piF+W/NVYS0Ehlf1BNuTrw==',key_name='tempest-keypair-1952883171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-637yl0h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=dd45343e-ffad-435a-83da-ad9c64fba838,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:79:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f832d39-3dac-4a72-ae5c-9ba95cd55983,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f832d39-3d') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG os_vif [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:79:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f832d39-3dac-4a72-ae5c-9ba95cd55983,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f832d39-3d') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39abf767-3f1e-5c26-bf75-aae07ec6142c', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f832d39-3d, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f832d39-3d, col_values=(('qos', UUID('268472ad-17ea-4d28-998a-1194bb56e745')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f832d39-3d, col_values=(('external_ids', {'iface-id': '1f832d39-3dac-4a72-ae5c-9ba95cd55983', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:79:6f', 'vm-uuid': 'dd45343e-ffad-435a-83da-ad9c64fba838'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:39 user nova-compute[74889]: INFO os_vif [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:79:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f832d39-3dac-4a72-ae5c-9ba95cd55983,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f832d39-3d')
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:11:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No VIF found with MAC fa:16:3e:34:79:6f, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:11:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Instance spawned successfully.
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:40 user nova-compute[74889]: INFO nova.compute.manager [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Took 7.00 seconds to spawn the instance on the hypervisor.
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:11:40 user nova-compute[74889]: INFO nova.compute.manager [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Took 7.94 seconds to build instance.
Nov 10 12:11:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7d649e4e-b9eb-44e9-8c50-2855bd8c07bb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.087s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-ed2a4311-b7fa-4161-a484-19806d3cee35 req-5aefd2b1-053d-4b9d-9eca-61a40f969293 service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received event network-changed-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.compute.manager [req-ed2a4311-b7fa-4161-a484-19806d3cee35 req-5aefd2b1-053d-4b9d-9eca-61a40f969293 service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Refreshing instance network info cache due to event network-changed-1f832d39-3dac-4a72-ae5c-9ba95cd55983. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ed2a4311-b7fa-4161-a484-19806d3cee35 req-5aefd2b1-053d-4b9d-9eca-61a40f969293 service nova] Acquiring lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ed2a4311-b7fa-4161-a484-19806d3cee35 req-5aefd2b1-053d-4b9d-9eca-61a40f969293 service nova] Acquired lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:11:40 user nova-compute[74889]: DEBUG nova.network.neutron [req-ed2a4311-b7fa-4161-a484-19806d3cee35 req-5aefd2b1-053d-4b9d-9eca-61a40f969293 service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Refreshing network info cache for port 1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-ed2a4311-b7fa-4161-a484-19806d3cee35 req-5aefd2b1-053d-4b9d-9eca-61a40f969293 service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Updated VIF entry in instance network info cache for port 1f832d39-3dac-4a72-ae5c-9ba95cd55983. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG nova.network.neutron [req-ed2a4311-b7fa-4161-a484-19806d3cee35 req-5aefd2b1-053d-4b9d-9eca-61a40f969293 service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Updating instance_info_cache with network_info: [{"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ed2a4311-b7fa-4161-a484-19806d3cee35 req-5aefd2b1-053d-4b9d-9eca-61a40f969293 service nova] Releasing lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-da65cdb9-ee5f-4978-8551-2d345cabb163 req-e639c3ca-e0dc-4e8a-8788-3c8d9155ce20 service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received event network-vif-plugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-da65cdb9-ee5f-4978-8551-2d345cabb163 req-e639c3ca-e0dc-4e8a-8788-3c8d9155ce20 service nova] Acquiring lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-da65cdb9-ee5f-4978-8551-2d345cabb163 req-e639c3ca-e0dc-4e8a-8788-3c8d9155ce20 service nova] Lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-da65cdb9-ee5f-4978-8551-2d345cabb163 req-e639c3ca-e0dc-4e8a-8788-3c8d9155ce20 service nova] Lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-da65cdb9-ee5f-4978-8551-2d345cabb163 req-e639c3ca-e0dc-4e8a-8788-3c8d9155ce20 service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] No waiting events found dispatching network-vif-plugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:41 user nova-compute[74889]: WARNING nova.compute.manager [req-da65cdb9-ee5f-4978-8551-2d345cabb163 req-e639c3ca-e0dc-4e8a-8788-3c8d9155ce20 service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received unexpected event network-vif-plugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 for instance with vm_state building and task_state spawning.
Nov 10 12:11:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:43 user nova-compute[74889]: INFO nova.compute.manager [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Took 10.72 seconds to detach 1 volumes for instance.
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb] Deleting volume: f9e012f6-ebd0-4c52-a368-c65b82b54147 {{(pid=74889) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-23f9dde5-b8ff-4239-8bd0-ddb8163d9745 req-10d3bd9f-cb4b-49b8-a024-032e819c45fa service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received event network-vif-plugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-23f9dde5-b8ff-4239-8bd0-ddb8163d9745 req-10d3bd9f-cb4b-49b8-a024-032e819c45fa service nova] Acquiring lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-23f9dde5-b8ff-4239-8bd0-ddb8163d9745 req-10d3bd9f-cb4b-49b8-a024-032e819c45fa service nova] Lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-23f9dde5-b8ff-4239-8bd0-ddb8163d9745 req-10d3bd9f-cb4b-49b8-a024-032e819c45fa service nova] Lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-23f9dde5-b8ff-4239-8bd0-ddb8163d9745 req-10d3bd9f-cb4b-49b8-a024-032e819c45fa service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] No waiting events found dispatching network-vif-plugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:11:43 user nova-compute[74889]: WARNING nova.compute.manager [req-23f9dde5-b8ff-4239-8bd0-ddb8163d9745 req-10d3bd9f-cb4b-49b8-a024-032e819c45fa service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received unexpected event network-vif-plugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 for instance with vm_state building and task_state spawning.
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:11:43 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Instance spawned successfully.
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:11:44 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Deleted allocations for instance 0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb
Nov 10 12:11:44 user nova-compute[74889]: INFO nova.compute.manager [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 10 12:11:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:11:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-90b11887-048d-4a2d-845b-dca77b7d375e tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "0cdba1fd-00af-4f62-bf9b-5b02a5ebc3cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.248s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:44 user nova-compute[74889]: INFO nova.compute.manager [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Took 7.19 seconds to build instance.
Nov 10 12:11:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-da777219-0e5c-4ba2-bd71-07d4c7768cf5 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.304s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:47 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:48 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:49 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:50 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:51 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:11:51 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:51 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:51 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:51 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:51 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:11:53 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:11:53 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8272MB free_disk=25.460330963134766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 516ca546-b343-4d97-943d-05b975b57f79 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 84d76753-0cf2-4444-a6fa-9a9500b769fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance dd45343e-ffad-435a-83da-ad9c64fba838 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:11:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 12:11:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 12:11:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 12:11:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 12:11:57 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:11:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:11:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:02 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:12:02 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:12:04 user nova-compute[74889]: INFO nova.virt.block_device [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Booting with volume 2dd148c2-6f11-4e2e-8691-cd118f6faeb0 at /dev/vdb
Nov 10 12:12:04 user nova-compute[74889]: DEBUG os_brick.utils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9746f8-4d04-4151-9f4a-e723d5d9e188]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bc6d99-f46b-420c-a554-9e38bdcd65b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "516ca546-b343-4d97-943d-05b975b57f79" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "516ca546-b343-4d97-943d-05b975b57f79" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "516ca546-b343-4d97-943d-05b975b57f79-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "516ca546-b343-4d97-943d-05b975b57f79-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "516ca546-b343-4d97-943d-05b975b57f79-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1276eead-979d-4a90-80b9-c49044bb9958]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:04 user nova-compute[74889]: INFO nova.compute.manager [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Terminating instance
Nov 10 12:12:04 user nova-compute[74889]: DEBUG nova.compute.manager [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[98861d34-705e-4b99-b311-66df0fb25e04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:12:04 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:12:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[976b4e07-cadc-4058-bb99-7c06628032fb]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG os_brick.utils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating existing volume attachment record: 3fbf36f9-2528-47c6-9f9b-7e18ee5ff273 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-ac013fbc-3a85-4bb5-800b-68dc5b9dbb84 req-4f284e67-b52e-4ec9-90bc-131575547916 service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received event network-vif-unplugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ac013fbc-3a85-4bb5-800b-68dc5b9dbb84 req-4f284e67-b52e-4ec9-90bc-131575547916 service nova] Acquiring lock "516ca546-b343-4d97-943d-05b975b57f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ac013fbc-3a85-4bb5-800b-68dc5b9dbb84 req-4f284e67-b52e-4ec9-90bc-131575547916 service nova] Lock "516ca546-b343-4d97-943d-05b975b57f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ac013fbc-3a85-4bb5-800b-68dc5b9dbb84 req-4f284e67-b52e-4ec9-90bc-131575547916 service nova] Lock "516ca546-b343-4d97-943d-05b975b57f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-ac013fbc-3a85-4bb5-800b-68dc5b9dbb84 req-4f284e67-b52e-4ec9-90bc-131575547916 service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] No waiting events found dispatching network-vif-unplugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-ac013fbc-3a85-4bb5-800b-68dc5b9dbb84 req-4f284e67-b52e-4ec9-90bc-131575547916 service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received event network-vif-unplugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:12:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Instance destroyed successfully.
Nov 10 12:12:05 user nova-compute[74889]: DEBUG nova.objects.instance [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lazy-loading 'resources' on Instance uuid 516ca546-b343-4d97-943d-05b975b57f79 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1515461920',display_name='tempest-ServerActionsTestOtherB-server-1515461920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1515461920',id=25,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1J+9rlEE005T5NZM7+h8MUvAdmv5ZpZtlZWi2+/cY52o6/JfSB4aTilWcZKF4MOh6cvdDqRGKphWCxUxbuOjoLckzjw1zyWVEkxAPhLjlEL33+5gZLeEkZBu0hbR2KtA==',key_name='tempest-keypair-48632366',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6edea315d6148c89ef7f9030eb614a9',ramdisk_id='',reservation_id='r-fvj20ytt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-552761030',owner_user_name='tempest-ServerActionsTestOtherB-552761030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bca3387bf3f434987d7596fb140bc6b',uuid=516ca546-b343-4d97-943d-05b975b57f79,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Converting VIF {"id": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "address": "fa:16:3e:fb:22:56", "network": {"id": "0b7e53da-155f-4e0d-bec9-08175e12d46e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-411753595-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6edea315d6148c89ef7f9030eb614a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5991ae27-b6", "ovs_interfaceid": "5991ae27-b6df-46f7-bf1d-bf4eea8c4592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fb:22:56,bridge_name='br-int',has_traffic_filtering=True,id=5991ae27-b6df-46f7-bf1d-bf4eea8c4592,network=Network(0b7e53da-155f-4e0d-bec9-08175e12d46e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5991ae27-b6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG os_vif [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:22:56,bridge_name='br-int',has_traffic_filtering=True,id=5991ae27-b6df-46f7-bf1d-bf4eea8c4592,network=Network(0b7e53da-155f-4e0d-bec9-08175e12d46e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5991ae27-b6') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5991ae27-b6, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=858a9df8-8f6c-4d43-8609-c81a7fd31350) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:05 user nova-compute[74889]: INFO os_vif [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fb:22:56,bridge_name='br-int',has_traffic_filtering=True,id=5991ae27-b6df-46f7-bf1d-bf4eea8c4592,network=Network(0b7e53da-155f-4e0d-bec9-08175e12d46e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5991ae27-b6')
Nov 10 12:12:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Deleting instance files /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79_del
Nov 10 12:12:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Deletion of /opt/stack/data/nova/instances/516ca546-b343-4d97-943d-05b975b57f79_del complete
Nov 10 12:12:05 user nova-compute[74889]: INFO nova.compute.manager [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 10 12:12:05 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:12:05 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 516ca546-b343-4d97-943d-05b975b57f79] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:12:06 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:12:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-17fd28d8-43e7-4247-b80c-b4f595452d4b req-667167ab-a3cd-4656-9301-bce436cf93a9 service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received event network-vif-deleted-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:12:06 user nova-compute[74889]: INFO nova.compute.manager [req-17fd28d8-43e7-4247-b80c-b4f595452d4b req-667167ab-a3cd-4656-9301-bce436cf93a9 service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Neutron deleted interface 5991ae27-b6df-46f7-bf1d-bf4eea8c4592; detaching it from the instance and deleting it from the info cache
Nov 10 12:12:06 user nova-compute[74889]: DEBUG nova.network.neutron [req-17fd28d8-43e7-4247-b80c-b4f595452d4b req-667167ab-a3cd-4656-9301-bce436cf93a9 service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:12:06 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Took 1.08 seconds to deallocate network for instance.
Nov 10 12:12:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-17fd28d8-43e7-4247-b80c-b4f595452d4b req-667167ab-a3cd-4656-9301-bce436cf93a9 service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Detach interface failed, port_id=5991ae27-b6df-46f7-bf1d-bf4eea8c4592, reason: Instance 516ca546-b343-4d97-943d-05b975b57f79 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:12:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:06 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:12:07 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:12:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:12:07 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Deleted allocations for instance 516ca546-b343-4d97-943d-05b975b57f79
Nov 10 12:12:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-730e4d17-204c-4ece-ac56-97ce7c97481b tempest-ServerActionsTestOtherB-552761030 tempest-ServerActionsTestOtherB-552761030-project-member] Lock "516ca546-b343-4d97-943d-05b975b57f79" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.573s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:12:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-99a4817e-a46b-469d-aa90-a7062ab43340 req-4ac44aaa-3357-4436-ac6d-056a9146f20d service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received event network-vif-plugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:12:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-99a4817e-a46b-469d-aa90-a7062ab43340 req-4ac44aaa-3357-4436-ac6d-056a9146f20d service nova] Acquiring lock "516ca546-b343-4d97-943d-05b975b57f79-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-99a4817e-a46b-469d-aa90-a7062ab43340 req-4ac44aaa-3357-4436-ac6d-056a9146f20d service nova] Lock "516ca546-b343-4d97-943d-05b975b57f79-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-99a4817e-a46b-469d-aa90-a7062ab43340 req-4ac44aaa-3357-4436-ac6d-056a9146f20d service nova] Lock "516ca546-b343-4d97-943d-05b975b57f79-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:12:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-99a4817e-a46b-469d-aa90-a7062ab43340 req-4ac44aaa-3357-4436-ac6d-056a9146f20d service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] No waiting events found dispatching network-vif-plugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:12:07 user nova-compute[74889]: WARNING nova.compute.manager [req-99a4817e-a46b-469d-aa90-a7062ab43340 req-4ac44aaa-3357-4436-ac6d-056a9146f20d service nova] [instance: 516ca546-b343-4d97-943d-05b975b57f79] Received unexpected event network-vif-plugged-5991ae27-b6df-46f7-bf1d-bf4eea8c4592 for instance with vm_state deleted and task_state None.
Nov 10 12:12:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:12:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:12:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:12:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:12:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:12:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:12:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:12:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:12:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:12:43 user nova-compute[74889]: INFO nova.compute.claims [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Claim successful on node user
Nov 10 12:12:43 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:12:43 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:12:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:12:43 user nova-compute[74889]: INFO nova.virt.block_device [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Booting with volume a903fda4-49d0-4f34-809e-8f9613e65b7c at /dev/vda
Nov 10 12:12:43 user nova-compute[74889]: DEBUG os_brick.utils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6568b8ee-df46-410a-a194-746575552dd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acb26e4-db21-4a2b-a340-307782a596d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG nova.policy [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b53b32c4dd094fb4a4b0618dc619b21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e703b195816426d9054c28fa6cd15cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61fa3ba-42fe-446c-8449-0b56ac0e05b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c2694d-6657-4497-953a-80bd172fc259]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:12:44 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:12:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ae7b85-7070-4747-b7cb-5cbf8c2bd754]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG os_brick.utils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Updating existing volume attachment record: 2acc9a82-ada8-4e66-818a-93aede0ec500 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:12:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Successfully created port: d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Successfully updated port: d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "refresh_cache-8ff94e81-7325-436e-9c48-f2e7dceb06b2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquired lock "refresh_cache-8ff94e81-7325-436e-9c48-f2e7dceb06b2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-3b6bcd69-0587-4193-896e-073d2cdf5aee req-36277957-9146-42cb-a023-c448bddb7b07 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received event network-changed-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-3b6bcd69-0587-4193-896e-073d2cdf5aee req-36277957-9146-42cb-a023-c448bddb7b07 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Refreshing instance network info cache due to event network-changed-d92219a7-7d86-4ab8-8e34-d6cd136eb818. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3b6bcd69-0587-4193-896e-073d2cdf5aee req-36277957-9146-42cb-a023-c448bddb7b07 service nova] Acquiring lock "refresh_cache-8ff94e81-7325-436e-9c48-f2e7dceb06b2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG nova.network.neutron [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Updating instance_info_cache with network_info: [{"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Releasing lock "refresh_cache-8ff94e81-7325-436e-9c48-f2e7dceb06b2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Instance network_info: |[{"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3b6bcd69-0587-4193-896e-073d2cdf5aee req-36277957-9146-42cb-a023-c448bddb7b07 service nova] Acquired lock "refresh_cache-8ff94e81-7325-436e-9c48-f2e7dceb06b2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:12:45 user nova-compute[74889]: DEBUG nova.network.neutron [req-3b6bcd69-0587-4193-896e-073d2cdf5aee req-36277957-9146-42cb-a023-c448bddb7b07 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Refreshing network info cache for port d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:12:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-3b6bcd69-0587-4193-896e-073d2cdf5aee req-36277957-9146-42cb-a023-c448bddb7b07 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Updated VIF entry in instance network info cache for port d92219a7-7d86-4ab8-8e34-d6cd136eb818. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:12:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-3b6bcd69-0587-4193-896e-073d2cdf5aee req-36277957-9146-42cb-a023-c448bddb7b07 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Updating instance_info_cache with network_info: [{"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:12:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3b6bcd69-0587-4193-896e-073d2cdf5aee req-36277957-9146-42cb-a023-c448bddb7b07 service nova] Releasing lock "refresh_cache-8ff94e81-7325-436e-9c48-f2e7dceb06b2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:12:49 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:12:49 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:12:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:12:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-d2e0a3ce-227a-415e-8072-4ff4fced3af7 req-20384e70-6f05-47b4-b0f6-18d08136e97f service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received event network-changed-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:12:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-d2e0a3ce-227a-415e-8072-4ff4fced3af7 req-20384e70-6f05-47b4-b0f6-18d08136e97f service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Refreshing instance network info cache due to event network-changed-ef4d2def-ac31-49a9-af55-c5f406b80a7a. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:12:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d2e0a3ce-227a-415e-8072-4ff4fced3af7 req-20384e70-6f05-47b4-b0f6-18d08136e97f service nova] Acquiring lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:12:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d2e0a3ce-227a-415e-8072-4ff4fced3af7 req-20384e70-6f05-47b4-b0f6-18d08136e97f service nova] Acquired lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:12:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-d2e0a3ce-227a-415e-8072-4ff4fced3af7 req-20384e70-6f05-47b4-b0f6-18d08136e97f service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Refreshing network info cache for port ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:12:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG nova.objects.instance [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lazy-loading 'flavor' on Instance uuid 84d76753-0cf2-4444-a6fa-9a9500b769fe {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:12:52 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Ignoring supplied device name: /dev/vdb
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG nova.network.neutron [req-d2e0a3ce-227a-415e-8072-4ff4fced3af7 req-20384e70-6f05-47b4-b0f6-18d08136e97f service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Updated VIF entry in instance network info cache for port ef4d2def-ac31-49a9-af55-c5f406b80a7a. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG nova.network.neutron [req-d2e0a3ce-227a-415e-8072-4ff4fced3af7 req-20384e70-6f05-47b4-b0f6-18d08136e97f service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Updating instance_info_cache with network_info: [{"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d2e0a3ce-227a-415e-8072-4ff4fced3af7 req-20384e70-6f05-47b4-b0f6-18d08136e97f service nova] Releasing lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:52 user nova-compute[74889]: INFO nova.compute.manager [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Attaching volume 062180dc-ad09-4bf0-a710-58a76fd66e4f to /dev/vdb
Nov 10 12:12:52 user nova-compute[74889]: DEBUG os_brick.utils [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a75cfb9-765c-4c72-9c8e-fea52d72c5c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d955a48-3d88-4361-8e86-a595957976b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[784535e0-072e-4e8b-b050-ef5a54302f42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3537be8d-ab6a-4aa6-90ef-9f3667baaa13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:12:52 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:12:52 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb5f8f3-da66-4df5-ae64-3a573199b0a3]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG os_brick.utils [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:12:52 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Updating existing volume attachment record: 5a2988e6-9d5b-4aaf-9a45-061cbe879a35 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Skipping network cache update for instance because it is Building. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Skipping network cache update for instance because it is Building. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid 84d76753-0cf2-4444-a6fa-9a9500b769fe {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Updating instance_info_cache with network_info: [{"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-84d76753-0cf2-4444-a6fa-9a9500b769fe" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:12:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:12:55 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:12:55 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8545MB free_disk=25.430023193359375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 84d76753-0cf2-4444-a6fa-9a9500b769fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance dd45343e-ffad-435a-83da-ad9c64fba838 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 8ff94e81-7325-436e-9c48-f2e7dceb06b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing inventories for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating ProviderTree inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing aggregate associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, aggregates: None {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 12:12:55 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing trait associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 12:12:56 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:12:56 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:12:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:12:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:12:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:12:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:12:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:12:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:01 user nova-compute[74889]: INFO nova.virt.block_device [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Booting with volume b75d1c65-0da8-460b-92cf-cac22f578897 at /dev/vdc
Nov 10 12:13:01 user nova-compute[74889]: DEBUG os_brick.utils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d5e802-765c-4313-abe2-39d7a1b21f47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a949fdee-3f0c-439f-8752-362c65da1ea1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b895910-5b36-41d1-ad24-be5e910a22d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c9076e-a9ea-4191-938a-cec7f0a94829]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:13:01 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:13:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bf14db-ec30-49a4-8e22-5017e35b8738]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG os_brick.utils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:13:01 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating existing volume attachment record: cf6b2cd8-114b-4c78-b5ae-4e4971c54cba {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:13:04 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:13:04 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:13:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:13:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:13:10 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Creating image(s)
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Ensure instance console log exists: /opt/stack/data/nova/instances/8ff94e81-7325-436e-9c48-f2e7dceb06b2/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Start _get_guest_xml network_info=[{"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjutlEDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ff94e81-7325-436e-9c48-f2e7dceb06b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a903fda4-49d0-4f34-809e-8f9613e65b7c', 'serial': 'a903fda4-49d0-4f34-809e-8f9613e65b7c'}, 'disk_bus': 'virtio', 'attachment_id': '2acc9a82-ada8-4e66-818a-93aede0ec500', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:13:10 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:13:10 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjutlEDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:13:10 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:13:10 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:13:10 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[00236cac-a27d-4a0e-b145-e8d9fdd85974]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:13:10 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbc5346-2d45-4e06-b17b-f52113e9cb4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c] added
Nov 10 12:13:10 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae29d2a-e663-4db9-8e89-ec4c38c63630]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0003db63-64fc-4a80-89a5-ac5b9b8af590]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjutlEDq {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjutlEDq" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8699f908-84fb-4ff3-9247-2802d91b20fe]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjutlEDq'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72173e3-a253-4f2c-8561-dcff41f0bfa4]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12e0c0b-0266-4dad-b607-7a07c2feb444]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 12:13:10 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:13:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 12:13:10 user nova-compute[74889]:  {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:13:10 user nova-compute[74889]: WARNING os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 12:13:10 user nova-compute[74889]: 
Nov 10 12:13:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[913810cf-a157-4bf7-9f28-3c9270e6da76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260]
Nov 10 12:13:11 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260] successful.
Nov 10 12:13:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[90054dee-2def-419e-bd0d-5d8b6cd9d1af]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f794c73b-0753-4673-b948-1ead034536e3]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[15815081-df64-48ea-9c42-787134aabda8]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:13:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjutlEDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23937383734363936', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937383734363936', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2120175791',display_name='tempest-TestVolumeBootPattern-server-2120175791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2120175791',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5sI8i7f1ePG/W7UaO+8+gsVMkmIp2O9S2Zp/OA7rnj2vqp7KJJD0civJv0L7iUGqDlP4rsFJ2tgFLkt5XPKycZVXji+0bjZyXuGwJUvRKhSllkY2ECb15wAksxQrkIeg==',key_name='tempest-TestVolumeBootPattern-597466952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-uex36myz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:12:44Z,user_data=None,user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=8ff94e81-7325-436e-9c48-f2e7dceb06b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:98:d1,bridge_name='br-int',has_traffic_filtering=True,id=d92219a7-7d86-4ab8-8e34-d6cd136eb818,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92219a7-7d') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.objects.instance [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ff94e81-7325-436e-9c48-f2e7dceb06b2 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:13:12 user nova-compute[74889]:   <uuid>8ff94e81-7325-436e-9c48-f2e7dceb06b2</uuid>
Nov 10 12:13:12 user nova-compute[74889]:   <name>instance-00000025</name>
Nov 10 12:13:12 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:13:12 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:13:12 user nova-compute[74889]:   <metadata>
Nov 10 12:13:12 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:13:12 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:13:12 user nova-compute[74889]:       <nova:name>tempest-TestVolumeBootPattern-server-2120175791</nova:name>
Nov 10 12:13:12 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:13:10</nova:creationTime>
Nov 10 12:13:12 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:13:12 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:13:12 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:13:12 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:13:12 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:13:12 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:13:12 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:13:12 user nova-compute[74889]:       <nova:owner>
Nov 10 12:13:12 user nova-compute[74889]:         <nova:user uuid="b53b32c4dd094fb4a4b0618dc619b21f">tempest-TestVolumeBootPattern-1577456798-project-member</nova:user>
Nov 10 12:13:12 user nova-compute[74889]:         <nova:project uuid="1e703b195816426d9054c28fa6cd15cc">tempest-TestVolumeBootPattern-1577456798</nova:project>
Nov 10 12:13:12 user nova-compute[74889]:       </nova:owner>
Nov 10 12:13:12 user nova-compute[74889]:       <nova:ports>
Nov 10 12:13:12 user nova-compute[74889]:         <nova:port uuid="d92219a7-7d86-4ab8-8e34-d6cd136eb818">
Nov 10 12:13:12 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 12:13:12 user nova-compute[74889]:         </nova:port>
Nov 10 12:13:12 user nova-compute[74889]:       </nova:ports>
Nov 10 12:13:12 user nova-compute[74889]:     </nova:instance>
Nov 10 12:13:12 user nova-compute[74889]:   </metadata>
Nov 10 12:13:12 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:13:12 user nova-compute[74889]:     <system>
Nov 10 12:13:12 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:13:12 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:13:12 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:13:12 user nova-compute[74889]:       <entry name="serial">8ff94e81-7325-436e-9c48-f2e7dceb06b2</entry>
Nov 10 12:13:12 user nova-compute[74889]:       <entry name="uuid">8ff94e81-7325-436e-9c48-f2e7dceb06b2</entry>
Nov 10 12:13:12 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:13:12 user nova-compute[74889]:     </system>
Nov 10 12:13:12 user nova-compute[74889]:   </sysinfo>
Nov 10 12:13:12 user nova-compute[74889]:   <os>
Nov 10 12:13:12 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:13:12 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:13:12 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:13:12 user nova-compute[74889]:   </os>
Nov 10 12:13:12 user nova-compute[74889]:   <features>
Nov 10 12:13:12 user nova-compute[74889]:     <acpi/>
Nov 10 12:13:12 user nova-compute[74889]:     <apic/>
Nov 10 12:13:12 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:13:12 user nova-compute[74889]:   </features>
Nov 10 12:13:12 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:13:12 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:13:12 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:13:12 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:13:12 user nova-compute[74889]:   </clock>
Nov 10 12:13:12 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:13:12 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:13:12 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:13:12 user nova-compute[74889]:   </cpu>
Nov 10 12:13:12 user nova-compute[74889]:   <devices>
Nov 10 12:13:12 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:13:12 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:13:12 user nova-compute[74889]:       <source dev="/dev/sdb"/>
Nov 10 12:13:12 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:13:12 user nova-compute[74889]:       <serial>a903fda4-49d0-4f34-809e-8f9613e65b7c</serial>
Nov 10 12:13:12 user nova-compute[74889]:     </disk>
Nov 10 12:13:12 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:13:12 user nova-compute[74889]:       <mac address="fa:16:3e:15:98:d1"/>
Nov 10 12:13:12 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:12 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:13:12 user nova-compute[74889]:       <target dev="tapd92219a7-7d"/>
Nov 10 12:13:12 user nova-compute[74889]:     </interface>
Nov 10 12:13:12 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:13:12 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/8ff94e81-7325-436e-9c48-f2e7dceb06b2/console.log" append="off"/>
Nov 10 12:13:12 user nova-compute[74889]:     </serial>
Nov 10 12:13:12 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:13:12 user nova-compute[74889]:     <video>
Nov 10 12:13:12 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:12 user nova-compute[74889]:     </video>
Nov 10 12:13:12 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:13:12 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:13:12 user nova-compute[74889]:     </rng>
Nov 10 12:13:12 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:13:12 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:13:12 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:13:12 user nova-compute[74889]:     </memballoon>
Nov 10 12:13:12 user nova-compute[74889]:   </devices>
Nov 10 12:13:12 user nova-compute[74889]: </domain>
Nov 10 12:13:12 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2120175791',display_name='tempest-TestVolumeBootPattern-server-2120175791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2120175791',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5sI8i7f1ePG/W7UaO+8+gsVMkmIp2O9S2Zp/OA7rnj2vqp7KJJD0civJv0L7iUGqDlP4rsFJ2tgFLkt5XPKycZVXji+0bjZyXuGwJUvRKhSllkY2ECb15wAksxQrkIeg==',key_name='tempest-TestVolumeBootPattern-597466952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-uex36myz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:12:44Z,user_data=None,user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=8ff94e81-7325-436e-9c48-f2e7dceb06b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:98:d1,bridge_name='br-int',has_traffic_filtering=True,id=d92219a7-7d86-4ab8-8e34-d6cd136eb818,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92219a7-7d') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG os_vif [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:98:d1,bridge_name='br-int',has_traffic_filtering=True,id=d92219a7-7d86-4ab8-8e34-d6cd136eb818,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92219a7-7d') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '609b40cd-ae21-5294-868b-15fd2c01d97c', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd92219a7-7d, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd92219a7-7d, col_values=(('qos', UUID('c343ba54-b1e8-42ae-a780-0065d1f46a25')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd92219a7-7d, col_values=(('external_ids', {'iface-id': 'd92219a7-7d86-4ab8-8e34-d6cd136eb818', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:98:d1', 'vm-uuid': '8ff94e81-7325-436e-9c48-f2e7dceb06b2'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:12 user nova-compute[74889]: INFO os_vif [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:98:d1,bridge_name='br-int',has_traffic_filtering=True,id=d92219a7-7d86-4ab8-8e34-d6cd136eb818,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92219a7-7d')
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:13:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] No VIF found with MAC fa:16:3e:15:98:d1, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:13:13 user nova-compute[74889]: INFO nova.compute.claims [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Claim successful on node user
Nov 10 12:13:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-39d22ec1-7378-46fd-8cc6-a42f81cff6f1 req-a5a40c52-39ff-4ee1-bad6-fe83de185b9f service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received event network-vif-plugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39d22ec1-7378-46fd-8cc6-a42f81cff6f1 req-a5a40c52-39ff-4ee1-bad6-fe83de185b9f service nova] Acquiring lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39d22ec1-7378-46fd-8cc6-a42f81cff6f1 req-a5a40c52-39ff-4ee1-bad6-fe83de185b9f service nova] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-39d22ec1-7378-46fd-8cc6-a42f81cff6f1 req-a5a40c52-39ff-4ee1-bad6-fe83de185b9f service nova] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-39d22ec1-7378-46fd-8cc6-a42f81cff6f1 req-a5a40c52-39ff-4ee1-bad6-fe83de185b9f service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] No waiting events found dispatching network-vif-plugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:13 user nova-compute[74889]: WARNING nova.compute.manager [req-39d22ec1-7378-46fd-8cc6-a42f81cff6f1 req-a5a40c52-39ff-4ee1-bad6-fe83de185b9f service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received unexpected event network-vif-plugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 for instance with vm_state building and task_state spawning.
Nov 10 12:13:13 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG nova.network.neutron [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:13:14 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:13:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG nova.policy [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37f23ef8bc05432096fc0bbeb4b29aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f2235110fb74639b0d81ee2c7586b8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:13:14 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Creating image(s)
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.268s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk 1073741824" returned: 0 in 0.051s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG nova.network.neutron [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Successfully created port: 4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.231s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:13:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Cannot resize image /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Ensure instance console log exists: /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.network.neutron [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Successfully updated port: 4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquired lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.network.neutron [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-b4d0911a-cc1b-4e67-a6b5-b479ec8f293e req-866763cf-2c3a-44f4-963d-6e2c43cdfd0c service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-changed-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-b4d0911a-cc1b-4e67-a6b5-b479ec8f293e req-866763cf-2c3a-44f4-963d-6e2c43cdfd0c service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Refreshing instance network info cache due to event network-changed-4c1e4117-f6a1-46d7-9864-d17dacfd1eea. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b4d0911a-cc1b-4e67-a6b5-b479ec8f293e req-866763cf-2c3a-44f4-963d-6e2c43cdfd0c service nova] Acquiring lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.network.neutron [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-1722b366-8ae5-44c3-978b-100e63602ccb req-433e855c-e194-4bfd-9491-c6ed89be16e0 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received event network-vif-plugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1722b366-8ae5-44c3-978b-100e63602ccb req-433e855c-e194-4bfd-9491-c6ed89be16e0 service nova] Acquiring lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1722b366-8ae5-44c3-978b-100e63602ccb req-433e855c-e194-4bfd-9491-c6ed89be16e0 service nova] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1722b366-8ae5-44c3-978b-100e63602ccb req-433e855c-e194-4bfd-9491-c6ed89be16e0 service nova] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-1722b366-8ae5-44c3-978b-100e63602ccb req-433e855c-e194-4bfd-9491-c6ed89be16e0 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] No waiting events found dispatching network-vif-plugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:15 user nova-compute[74889]: WARNING nova.compute.manager [req-1722b366-8ae5-44c3-978b-100e63602ccb req-433e855c-e194-4bfd-9491-c6ed89be16e0 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received unexpected event network-vif-plugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 for instance with vm_state building and task_state spawning.
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.network.neutron [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating instance_info_cache with network_info: [{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Releasing lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Instance network_info: |[{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b4d0911a-cc1b-4e67-a6b5-b479ec8f293e req-866763cf-2c3a-44f4-963d-6e2c43cdfd0c service nova] Acquired lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-b4d0911a-cc1b-4e67-a6b5-b479ec8f293e req-866763cf-2c3a-44f4-963d-6e2c43cdfd0c service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Refreshing network info cache for port 4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Start _get_guest_xml network_info=[{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:13:15 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:13:15 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-137397044',display_name='tempest-ServerStableDeviceRescueTest-server-137397044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-137397044',id=38,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPiHED/O3YxLE3/Pozk1GrEwY9VoJaFyDb5ArKwcg5/nUF6NifLRMQLba9hOy2RYEEK6YhuTdNvZMDr9wwXh2lyTycQbYofYq9VLGyvvTKR+N5oDM7jKla4GRF4HwEP3w==',key_name='tempest-keypair-1720706475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f2235110fb74639b0d81ee2c7586b8b',ramdisk_id='',reservation_id='r-8f9jgm34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1835119920',owner_user_name='tempest-ServerStableDeviceRescueTest-1835119920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37f23ef8bc05432096fc0bbeb4b29aca',uuid=903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Converting VIF {"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:39,bridge_name='br-int',has_traffic_filtering=True,id=4c1e4117-f6a1-46d7-9864-d17dacfd1eea,network=Network(184818ba-92f6-4840-89da-7721d94fb9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e4117-f6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:15 user nova-compute[74889]: DEBUG nova.objects.instance [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'pci_devices' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:13:16 user nova-compute[74889]:   <uuid>903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4</uuid>
Nov 10 12:13:16 user nova-compute[74889]:   <name>instance-00000026</name>
Nov 10 12:13:16 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:13:16 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:13:16 user nova-compute[74889]:   <metadata>
Nov 10 12:13:16 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:13:16 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:13:16 user nova-compute[74889]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-137397044</nova:name>
Nov 10 12:13:16 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:13:15</nova:creationTime>
Nov 10 12:13:16 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:13:16 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:13:16 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:13:16 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:13:16 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:13:16 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:13:16 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:13:16 user nova-compute[74889]:       <nova:owner>
Nov 10 12:13:16 user nova-compute[74889]:         <nova:user uuid="37f23ef8bc05432096fc0bbeb4b29aca">tempest-ServerStableDeviceRescueTest-1835119920-project-member</nova:user>
Nov 10 12:13:16 user nova-compute[74889]:         <nova:project uuid="1f2235110fb74639b0d81ee2c7586b8b">tempest-ServerStableDeviceRescueTest-1835119920</nova:project>
Nov 10 12:13:16 user nova-compute[74889]:       </nova:owner>
Nov 10 12:13:16 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:13:16 user nova-compute[74889]:       <nova:ports>
Nov 10 12:13:16 user nova-compute[74889]:         <nova:port uuid="4c1e4117-f6a1-46d7-9864-d17dacfd1eea">
Nov 10 12:13:16 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 12:13:16 user nova-compute[74889]:         </nova:port>
Nov 10 12:13:16 user nova-compute[74889]:       </nova:ports>
Nov 10 12:13:16 user nova-compute[74889]:     </nova:instance>
Nov 10 12:13:16 user nova-compute[74889]:   </metadata>
Nov 10 12:13:16 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:13:16 user nova-compute[74889]:     <system>
Nov 10 12:13:16 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:13:16 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:13:16 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:13:16 user nova-compute[74889]:       <entry name="serial">903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4</entry>
Nov 10 12:13:16 user nova-compute[74889]:       <entry name="uuid">903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4</entry>
Nov 10 12:13:16 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:13:16 user nova-compute[74889]:     </system>
Nov 10 12:13:16 user nova-compute[74889]:   </sysinfo>
Nov 10 12:13:16 user nova-compute[74889]:   <os>
Nov 10 12:13:16 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:13:16 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:13:16 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:13:16 user nova-compute[74889]:   </os>
Nov 10 12:13:16 user nova-compute[74889]:   <features>
Nov 10 12:13:16 user nova-compute[74889]:     <acpi/>
Nov 10 12:13:16 user nova-compute[74889]:     <apic/>
Nov 10 12:13:16 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:13:16 user nova-compute[74889]:   </features>
Nov 10 12:13:16 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:13:16 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:13:16 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:13:16 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:13:16 user nova-compute[74889]:   </clock>
Nov 10 12:13:16 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:13:16 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:13:16 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:13:16 user nova-compute[74889]:   </cpu>
Nov 10 12:13:16 user nova-compute[74889]:   <devices>
Nov 10 12:13:16 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:13:16 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:13:16 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk"/>
Nov 10 12:13:16 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:13:16 user nova-compute[74889]:     </disk>
Nov 10 12:13:16 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:13:16 user nova-compute[74889]:       <mac address="fa:16:3e:c1:3f:39"/>
Nov 10 12:13:16 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:16 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:13:16 user nova-compute[74889]:       <target dev="tap4c1e4117-f6"/>
Nov 10 12:13:16 user nova-compute[74889]:     </interface>
Nov 10 12:13:16 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:13:16 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/console.log" append="off"/>
Nov 10 12:13:16 user nova-compute[74889]:     </serial>
Nov 10 12:13:16 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:13:16 user nova-compute[74889]:     <video>
Nov 10 12:13:16 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:16 user nova-compute[74889]:     </video>
Nov 10 12:13:16 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:13:16 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:13:16 user nova-compute[74889]:     </rng>
Nov 10 12:13:16 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:13:16 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:13:16 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:13:16 user nova-compute[74889]:     </memballoon>
Nov 10 12:13:16 user nova-compute[74889]:   </devices>
Nov 10 12:13:16 user nova-compute[74889]: </domain>
Nov 10 12:13:16 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-137397044',display_name='tempest-ServerStableDeviceRescueTest-server-137397044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-137397044',id=38,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPiHED/O3YxLE3/Pozk1GrEwY9VoJaFyDb5ArKwcg5/nUF6NifLRMQLba9hOy2RYEEK6YhuTdNvZMDr9wwXh2lyTycQbYofYq9VLGyvvTKR+N5oDM7jKla4GRF4HwEP3w==',key_name='tempest-keypair-1720706475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f2235110fb74639b0d81ee2c7586b8b',ramdisk_id='',reservation_id='r-8f9jgm34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1835119920',owner_user_name='tempest-ServerStableDeviceRescueTest-1835119920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:13:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37f23ef8bc05432096fc0bbeb4b29aca',uuid=903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Converting VIF {"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:39,bridge_name='br-int',has_traffic_filtering=True,id=4c1e4117-f6a1-46d7-9864-d17dacfd1eea,network=Network(184818ba-92f6-4840-89da-7721d94fb9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e4117-f6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG os_vif [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:39,bridge_name='br-int',has_traffic_filtering=True,id=4c1e4117-f6a1-46d7-9864-d17dacfd1eea,network=Network(184818ba-92f6-4840-89da-7721d94fb9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e4117-f6') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9cf1429-687c-59f6-ab68-2fcdae5a61b4', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c1e4117-f6, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4c1e4117-f6, col_values=(('qos', UUID('0c2feb3d-aa40-49ac-afba-d67cf2b9bfc8')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4c1e4117-f6, col_values=(('external_ids', {'iface-id': '4c1e4117-f6a1-46d7-9864-d17dacfd1eea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:3f:39', 'vm-uuid': '903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:16 user nova-compute[74889]: INFO os_vif [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:39,bridge_name='br-int',has_traffic_filtering=True,id=4c1e4117-f6a1-46d7-9864-d17dacfd1eea,network=Network(184818ba-92f6-4840-89da-7721d94fb9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e4117-f6')
Nov 10 12:13:16 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Instance spawned successfully.
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] No VIF found with MAC fa:16:3e:c1:3f:39, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:13:16 user nova-compute[74889]: INFO nova.compute.manager [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:13:16 user nova-compute[74889]: INFO nova.compute.manager [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Took 32.89 seconds to build instance.
Nov 10 12:13:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-0e2ce8af-435b-4a16-9b61-f9e782198088 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.999s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.network.neutron [req-b4d0911a-cc1b-4e67-a6b5-b479ec8f293e req-866763cf-2c3a-44f4-963d-6e2c43cdfd0c service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updated VIF entry in instance network info cache for port 4c1e4117-f6a1-46d7-9864-d17dacfd1eea. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG nova.network.neutron [req-b4d0911a-cc1b-4e67-a6b5-b479ec8f293e req-866763cf-2c3a-44f4-963d-6e2c43cdfd0c service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating instance_info_cache with network_info: [{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:13:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b4d0911a-cc1b-4e67-a6b5-b479ec8f293e req-866763cf-2c3a-44f4-963d-6e2c43cdfd0c service nova] Releasing lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:13:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:17 user nova-compute[74889]: DEBUG nova.compute.manager [req-a381dc4f-2d9b-4cdc-b2ff-263ab12ef083 req-97c4e05a-9e1d-442e-9cc6-a927e30b7e90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a381dc4f-2d9b-4cdc-b2ff-263ab12ef083 req-97c4e05a-9e1d-442e-9cc6-a927e30b7e90 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a381dc4f-2d9b-4cdc-b2ff-263ab12ef083 req-97c4e05a-9e1d-442e-9cc6-a927e30b7e90 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a381dc4f-2d9b-4cdc-b2ff-263ab12ef083 req-97c4e05a-9e1d-442e-9cc6-a927e30b7e90 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:17 user nova-compute[74889]: DEBUG nova.compute.manager [req-a381dc4f-2d9b-4cdc-b2ff-263ab12ef083 req-97c4e05a-9e1d-442e-9cc6-a927e30b7e90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:17 user nova-compute[74889]: WARNING nova.compute.manager [req-a381dc4f-2d9b-4cdc-b2ff-263ab12ef083 req-97c4e05a-9e1d-442e-9cc6-a927e30b7e90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state building and task_state spawning.
Nov 10 12:13:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPwsEvGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:13:18 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:13:18 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:13:18 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8248be6-6503-4ade-8142-eef1b5682111]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:13:18 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc82ce6-9984-4b58-8e8b-93b74e454c34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f] added
Nov 10 12:13:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e77c87-4dfa-4893-8c97-0e8a5969e10e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[386f319a-3deb-4aa8-84e2-a88a0fd3b88e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPwsEvGa {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mPwsEvGa" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ab6b78-443f-4b27-b823-7ec004802514]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mPwsEvGa'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[53825acc-f803-42c7-98a6-c8f3dd673cfe]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fed98e-0dee-41fb-bc57-d1c679ea74ab]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7713d3-cce6-4dfa-bb93-757a1be038c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f, portal: 172.16.0.220,3260]
Nov 10 12:13:18 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f, portal: 172.16.0.220,3260] successful.
Nov 10 12:13:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32b28ee-95c2-41d0-ba26-88e0d7e7e04f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1a2c7b-0d32-4e21-9bdc-6504c6526c2f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:18 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:18 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74c6ed2-1fd5-4f24-a6ed-b617680961d1]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:13:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPwsEvGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:13:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:13:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26134656537373835', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:13:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134656537373835', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:13:19 user nova-compute[74889]: DEBUG nova.objects.instance [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lazy-loading 'flavor' on Instance uuid 84d76753-0cf2-4444-a6fa-9a9500b769fe {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:13:20 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:13:20 user nova-compute[74889]:   <source dev="/dev/sdc"/>
Nov 10 12:13:20 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:13:20 user nova-compute[74889]:   <serial>062180dc-ad09-4bf0-a710-58a76fd66e4f</serial>
Nov 10 12:13:20 user nova-compute[74889]: </disk>
Nov 10 12:13:20 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:13:20 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Instance spawned successfully.
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-c276dfc7-7ba2-493d-a32b-cc1bca5d7bd9 req-a7b669c3-9250-4b66-a0a6-1a5eeaf9bc93 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c276dfc7-7ba2-493d-a32b-cc1bca5d7bd9 req-a7b669c3-9250-4b66-a0a6-1a5eeaf9bc93 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c276dfc7-7ba2-493d-a32b-cc1bca5d7bd9 req-a7b669c3-9250-4b66-a0a6-1a5eeaf9bc93 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c276dfc7-7ba2-493d-a32b-cc1bca5d7bd9 req-a7b669c3-9250-4b66-a0a6-1a5eeaf9bc93 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-c276dfc7-7ba2-493d-a32b-cc1bca5d7bd9 req-a7b669c3-9250-4b66-a0a6-1a5eeaf9bc93 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:20 user nova-compute[74889]: WARNING nova.compute.manager [req-c276dfc7-7ba2-493d-a32b-cc1bca5d7bd9 req-a7b669c3-9250-4b66-a0a6-1a5eeaf9bc93 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state building and task_state spawning.
Nov 10 12:13:20 user nova-compute[74889]: INFO nova.compute.manager [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:13:20 user nova-compute[74889]: INFO nova.compute.manager [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Took 6.86 seconds to build instance.
Nov 10 12:13:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a61ff71a-0144-481b-b60e-2506740c46a7 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] No VIF found with MAC fa:16:3e:46:e7:68, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:13:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-861b254e-0b68-4a6e-826d-6ee274b89309 tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.403s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:23 user nova-compute[74889]: DEBUG nova.compute.manager [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:13:23 user nova-compute[74889]: INFO nova.compute.manager [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] instance snapshotting
Nov 10 12:13:23 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Beginning live snapshot process
Nov 10 12:13:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json -f qcow2 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json -f qcow2 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.208s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpljy1ma1w/fb99a57037b8416992e17cfde558c8d8.delta 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpljy1ma1w/fb99a57037b8416992e17cfde558c8d8.delta 1073741824" returned: 0 in 0.069s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 12:13:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 12:13:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 12:13:26 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 12:13:26 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:13:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpljy1ma1w/fb99a57037b8416992e17cfde558c8d8.delta /opt/stack/data/nova/instances/snapshots/tmpljy1ma1w/fb99a57037b8416992e17cfde558c8d8 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:26 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpljy1ma1w/fb99a57037b8416992e17cfde558c8d8.delta /opt/stack/data/nova/instances/snapshots/tmpljy1ma1w/fb99a57037b8416992e17cfde558c8d8" returned: 0 in 0.545s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:26 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Snapshot extracted, beginning image upload
Nov 10 12:13:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-f562607f-3b8b-4287-969c-e49d175bde2d req-4219b647-5e3f-4c68-8c6b-4db38027dbcc service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received event network-changed-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-f562607f-3b8b-4287-969c-e49d175bde2d req-4219b647-5e3f-4c68-8c6b-4db38027dbcc service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Refreshing instance network info cache due to event network-changed-1f832d39-3dac-4a72-ae5c-9ba95cd55983. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:13:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f562607f-3b8b-4287-969c-e49d175bde2d req-4219b647-5e3f-4c68-8c6b-4db38027dbcc service nova] Acquiring lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:13:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f562607f-3b8b-4287-969c-e49d175bde2d req-4219b647-5e3f-4c68-8c6b-4db38027dbcc service nova] Acquired lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:13:27 user nova-compute[74889]: DEBUG nova.network.neutron [req-f562607f-3b8b-4287-969c-e49d175bde2d req-4219b647-5e3f-4c68-8c6b-4db38027dbcc service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Refreshing network info cache for port 1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:13:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-f562607f-3b8b-4287-969c-e49d175bde2d req-4219b647-5e3f-4c68-8c6b-4db38027dbcc service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Updated VIF entry in instance network info cache for port 1f832d39-3dac-4a72-ae5c-9ba95cd55983. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:13:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-f562607f-3b8b-4287-969c-e49d175bde2d req-4219b647-5e3f-4c68-8c6b-4db38027dbcc service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Updating instance_info_cache with network_info: [{"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:13:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f562607f-3b8b-4287-969c-e49d175bde2d req-4219b647-5e3f-4c68-8c6b-4db38027dbcc service nova] Releasing lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:13:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:30 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Snapshot image upload complete
Nov 10 12:13:30 user nova-compute[74889]: INFO nova.compute.manager [None req-13a9c16f-d9cb-412e-a236-1a0fc962a016 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Took 6.26 seconds to snapshot the instance on the hypervisor.
Nov 10 12:13:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "dd45343e-ffad-435a-83da-ad9c64fba838" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.objects.instance [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'flavor' on Instance uuid dd45343e-ffad-435a-83da-ad9c64fba838 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:13:35 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Creating image(s)
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Ensure instance console log exists: /opt/stack/data/nova/instances/6d20b9d9-dfdd-4432-bb91-3bb6d6a905de/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Start _get_guest_xml network_info=[{"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmOZoJHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d20b9d9-dfdd-4432-bb91-3bb6d6a905de', 'attached_at': '', 'detached_at': '', 'volume_id': '24ed6795-3545-4675-8826-e2cec2254d42', 'serial': '24ed6795-3545-4675-8826-e2cec2254d42'}, 'disk_bus': 'virtio', 'attachment_id': '6fc4e47e-5889-4eb3-9046-f47816b34017', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuyoehnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d20b9d9-dfdd-4432-bb91-3bb6d6a905de', 'attached_at': '', 'detached_at': '', 'volume_id': '2dd148c2-6f11-4e2e-8691-cd118f6faeb0', 'serial': '2dd148c2-6f11-4e2e-8691-cd118f6faeb0'}, 'disk_bus': 'virtio', 'attachment_id': '3fbf36f9-2528-47c6-9f9b-7e18ee5ff273', 'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None}, {'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAvpTFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d20b9d9-dfdd-4432-bb91-3bb6d6a905de', 'attached_at': '', 'detached_at': '', 'volume_id': 'b75d1c65-0da8-460b-92cf-cac22f578897', 'serial': 'b75d1c65-0da8-460b-92cf-cac22f578897'}, 'disk_bus': 'virtio', 'attachment_id': 'cf6b2cd8-114b-4c78-b5ae-4e4971c54cba', 'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:13:35 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:13:35 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmOZoJHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:13:35 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:13:35 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:13:35 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ed4f9f-3f18-49df-aeff-59158bb02c01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:13:35 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "dd45343e-ffad-435a-83da-ad9c64fba838" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:35 user nova-compute[74889]: INFO nova.compute.manager [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Attaching volume 46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 to /dev/vdb
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f18918-8374-4e8e-9bbe-fb91ebde1672]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42] added
Nov 10 12:13:35 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7248ab26-6174-4169-a6f3-1d1db7a4c0ac]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.utils [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0191de62-1165-4ee9-b91c-b962bfec4f14]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmOZoJHL {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[028f666d-e685-4f04-ab11-9a2cd56f5fab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pmOZoJHL" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59010a1-5701-44c7-8e0f-6309b892afe7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pmOZoJHL'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d529b63-7785-4d3b-95a4-e8facd64b0b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.065s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8285662-55c1-45b3-afa2-3f65ce5913a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a73826-aa4d-4dc7-ae2c-46e98eb8bcda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.077s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d0b435-56b7-41d7-ade3-86b3dd46371c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:13:35 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[82be67a9-09d7-494b-bd43-02395cdfc6fd]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.utils [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Updating existing volume attachment record: 690c91dd-a106-44a9-b9d2-ada21d1fdea8 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38873e5-69ad-47b0-beb7-b640f74827b9]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:35 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:35 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:35 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:35 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:13:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --login" returned: 0 in 1.061s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60e3b2f-e909-469b-8114-0612f9b057f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42, portal: 172.16.0.220,3260]
Nov 10 12:13:36 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42, portal: 172.16.0.220,3260] successful.
Nov 10 12:13:36 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41b592e-b9c3-4682-843c-1918acd0569b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[80126362-f39c-4f64-95b6-f6d054d2577d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:36 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:36 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:13:36 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:36 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:36 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:13:36 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.459s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e280ef-b182-4dc2-b3e4-093f60d0c210]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:13:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmOZoJHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.500s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] <== connect_volume: return (2502ms) {'type': 'block', 'scsi_wwn': '23333316439316131', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333316439316131', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuyoehnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:13:37 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:13:37 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:13:37 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ce808-a67d-43de-aa5b-fc1c085e87c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:13:37 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1e2802-12cd-4a4e-90e3-17b7a82fc637]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0] added
Nov 10 12:13:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c72a22-0706-4ba0-9510-83ee9533812b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[99beac36-33b0-40c4-a292-bd4e02a3ac6e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuyoehnW {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VuyoehnW" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6634a8de-294e-40f7-85d9-888941dba061]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VuyoehnW'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6f2f01-ffd7-4224-8a48-c835577875c7]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afac085-e722-478f-b13a-b35026d64a1c]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:38 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:38 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:13:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:38 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:38 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:13:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[38704f96-48e9-4806-8b5b-55000da43c10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0, portal: 172.16.0.220,3260]
Nov 10 12:13:38 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0, portal: 172.16.0.220,3260] successful.
Nov 10 12:13:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb464ecc-fcc9-47c2-94a5-1e2c9caa6420]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[55be4fde-d38d-4a7e-9435-8cac52feaf26]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:38 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:38 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:13:38 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:13:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:38 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:38 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:13:38 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:13:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd947874-e536-47c5-ade3-ead39495d8a5]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuyoehnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23839643662306335', 'path': '/dev/sde'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839643662306335', 'path': '/dev/sde'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAvpTFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:13:39 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:13:39 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:13:39 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[be48ed2b-2f38-4547-9dc1-3e58d1fa5bfa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:13:39 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b81f56-e6cc-4e17-9613-d925ebdb4423]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897] added
Nov 10 12:13:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[28010c1d-1fd5-456c-aa54-5b835d351d8b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db4dade-3b75-4b8f-97bb-6821e5383dcb]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HAvpTFjO {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HAvpTFjO" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47dd7dd-8543-462a-94d2-471f108b1aa1]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HAvpTFjO'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[717ab87d-9270-4ffa-a3e0-905e6ca3c55a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6959b06-e7de-44d2-b18a-b93a1079ff35]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:13:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:13:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60eeaad-eea8-44cc-a76f-78e4123257dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897, portal: 172.16.0.220,3260]
Nov 10 12:13:39 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897, portal: 172.16.0.220,3260] successful.
Nov 10 12:13:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca2bf12-148e-4e6a-b7b3-d32590244c04]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[745e21c3-e21b-4386-8b4a-0b5e1d6284f6]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:13:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:13:39 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:13:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] HCTL ('37', '-', '-', 0) found on session 42 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f9b7e-47b3-43a7-a9b5-000618a062dd]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Searching for a device in session 42 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAvpTFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:13:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26137353033636133', 'path': '/dev/sdf'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137353033636133', 'path': '/dev/sdf'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:81:7e,bridge_name='br-int',has_traffic_filtering=True,id=c48dd5ca-ff1b-43d2-aa2b-28876a27b698,network=Network(aa578c0e-96d4-458e-ab66-c50d2934261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48dd5ca-ff') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3b:14,bridge_name='br-int',has_traffic_filtering=True,id=ad634c53-9335-4a00-8976-d6f66f2462fc,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad634c53-93') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:58:29,bridge_name='br-int',has_traffic_filtering=True,id=bd0d21a9-d10e-4de0-9348-74adff8baad3,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd0d21a9-d1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:43:52,bridge_name='br-int',has_traffic_filtering=True,id=d36952a8-d18b-4234-9829-3160f2e1882e,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36952a8-d1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=65117c96-c353-458c-9df6-48237186ca2d,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65117c96-c3') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:8e:05,bridge_name='br-int',has_traffic_filtering=True,id=57ea1ebe-c6fa-4cee-9718-db0369133dc2,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ea1ebe-c6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=ccd32963-90a4-40ee-8d7e-e9896a20483c,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd32963-90') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:13:40 user nova-compute[74889]:   <uuid>6d20b9d9-dfdd-4432-bb91-3bb6d6a905de</uuid>
Nov 10 12:13:40 user nova-compute[74889]:   <name>instance-00000022</name>
Nov 10 12:13:40 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:13:40 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:13:40 user nova-compute[74889]:   <metadata>
Nov 10 12:13:40 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:13:40 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:13:40 user nova-compute[74889]:       <nova:name>tempest-device-tagging-server-1455089407</nova:name>
Nov 10 12:13:40 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:13:35</nova:creationTime>
Nov 10 12:13:40 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:13:40 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:13:40 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:13:40 user nova-compute[74889]:       <nova:owner>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:user uuid="627e26b7a67f41dabc010d18327219d5">tempest-TaggedBootDevicesTest_v242-2060735194-project-member</nova:user>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:project uuid="44f81df6b2364ab4a0f6577d58aeb413">tempest-TaggedBootDevicesTest_v242-2060735194</nova:project>
Nov 10 12:13:40 user nova-compute[74889]:       </nova:owner>
Nov 10 12:13:40 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:13:40 user nova-compute[74889]:       <nova:ports>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:port uuid="c48dd5ca-ff1b-43d2-aa2b-28876a27b698">
Nov 10 12:13:40 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 12:13:40 user nova-compute[74889]:         </nova:port>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:port uuid="ad634c53-9335-4a00-8976-d6f66f2462fc">
Nov 10 12:13:40 user nova-compute[74889]:           <nova:ip type="fixed" address="10.1.1.189" ipVersion="4"/>
Nov 10 12:13:40 user nova-compute[74889]:         </nova:port>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:port uuid="bd0d21a9-d10e-4de0-9348-74adff8baad3">
Nov 10 12:13:40 user nova-compute[74889]:           <nova:ip type="fixed" address="10.1.1.161" ipVersion="4"/>
Nov 10 12:13:40 user nova-compute[74889]:         </nova:port>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:port uuid="d36952a8-d18b-4234-9829-3160f2e1882e">
Nov 10 12:13:40 user nova-compute[74889]:           <nova:ip type="fixed" address="10.1.1.127" ipVersion="4"/>
Nov 10 12:13:40 user nova-compute[74889]:         </nova:port>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:port uuid="65117c96-c353-458c-9df6-48237186ca2d">
Nov 10 12:13:40 user nova-compute[74889]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Nov 10 12:13:40 user nova-compute[74889]:         </nova:port>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:port uuid="57ea1ebe-c6fa-4cee-9718-db0369133dc2">
Nov 10 12:13:40 user nova-compute[74889]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 10 12:13:40 user nova-compute[74889]:         </nova:port>
Nov 10 12:13:40 user nova-compute[74889]:         <nova:port uuid="ccd32963-90a4-40ee-8d7e-e9896a20483c">
Nov 10 12:13:40 user nova-compute[74889]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 10 12:13:40 user nova-compute[74889]:         </nova:port>
Nov 10 12:13:40 user nova-compute[74889]:       </nova:ports>
Nov 10 12:13:40 user nova-compute[74889]:     </nova:instance>
Nov 10 12:13:40 user nova-compute[74889]:   </metadata>
Nov 10 12:13:40 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:13:40 user nova-compute[74889]:     <system>
Nov 10 12:13:40 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:13:40 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:13:40 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:13:40 user nova-compute[74889]:       <entry name="serial">6d20b9d9-dfdd-4432-bb91-3bb6d6a905de</entry>
Nov 10 12:13:40 user nova-compute[74889]:       <entry name="uuid">6d20b9d9-dfdd-4432-bb91-3bb6d6a905de</entry>
Nov 10 12:13:40 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:13:40 user nova-compute[74889]:     </system>
Nov 10 12:13:40 user nova-compute[74889]:   </sysinfo>
Nov 10 12:13:40 user nova-compute[74889]:   <os>
Nov 10 12:13:40 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:13:40 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:13:40 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:13:40 user nova-compute[74889]:   </os>
Nov 10 12:13:40 user nova-compute[74889]:   <features>
Nov 10 12:13:40 user nova-compute[74889]:     <acpi/>
Nov 10 12:13:40 user nova-compute[74889]:     <apic/>
Nov 10 12:13:40 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:13:40 user nova-compute[74889]:   </features>
Nov 10 12:13:40 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:13:40 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:13:40 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:13:40 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:13:40 user nova-compute[74889]:   </clock>
Nov 10 12:13:40 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:13:40 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:13:40 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:13:40 user nova-compute[74889]:   </cpu>
Nov 10 12:13:40 user nova-compute[74889]:   <devices>
Nov 10 12:13:40 user nova-compute[74889]:     <disk type="file" device="cdrom">
Nov 10 12:13:40 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 12:13:40 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/6d20b9d9-dfdd-4432-bb91-3bb6d6a905de/disk.config"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="hda" bus="ide"/>
Nov 10 12:13:40 user nova-compute[74889]:     </disk>
Nov 10 12:13:40 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:13:40 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:13:40 user nova-compute[74889]:       <source dev="/dev/sdd"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:       <serial>24ed6795-3545-4675-8826-e2cec2254d42</serial>
Nov 10 12:13:40 user nova-compute[74889]:     </disk>
Nov 10 12:13:40 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:13:40 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:13:40 user nova-compute[74889]:       <source dev="/dev/sde"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:       <serial>2dd148c2-6f11-4e2e-8691-cd118f6faeb0</serial>
Nov 10 12:13:40 user nova-compute[74889]:     </disk>
Nov 10 12:13:40 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:13:40 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:13:40 user nova-compute[74889]:       <source dev="/dev/sdf"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="vdc" bus="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:       <serial>b75d1c65-0da8-460b-92cf-cac22f578897</serial>
Nov 10 12:13:40 user nova-compute[74889]:     </disk>
Nov 10 12:13:40 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:13:40 user nova-compute[74889]:       <mac address="fa:16:3e:8b:81:7e"/>
Nov 10 12:13:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="tapc48dd5ca-ff"/>
Nov 10 12:13:40 user nova-compute[74889]:     </interface>
Nov 10 12:13:40 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:13:40 user nova-compute[74889]:       <mac address="fa:16:3e:a7:3b:14"/>
Nov 10 12:13:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="tapad634c53-93"/>
Nov 10 12:13:40 user nova-compute[74889]:     </interface>
Nov 10 12:13:40 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:13:40 user nova-compute[74889]:       <mac address="fa:16:3e:a0:58:29"/>
Nov 10 12:13:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="tapbd0d21a9-d1"/>
Nov 10 12:13:40 user nova-compute[74889]:     </interface>
Nov 10 12:13:40 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:13:40 user nova-compute[74889]:       <mac address="fa:16:3e:5b:43:52"/>
Nov 10 12:13:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="tapd36952a8-d1"/>
Nov 10 12:13:40 user nova-compute[74889]:     </interface>
Nov 10 12:13:40 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:13:40 user nova-compute[74889]:       <mac address="fa:16:3e:53:b7:fd"/>
Nov 10 12:13:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="tap65117c96-c3"/>
Nov 10 12:13:40 user nova-compute[74889]:     </interface>
Nov 10 12:13:40 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:13:40 user nova-compute[74889]:       <mac address="fa:16:3e:55:8e:05"/>
Nov 10 12:13:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="tap57ea1ebe-c6"/>
Nov 10 12:13:40 user nova-compute[74889]:     </interface>
Nov 10 12:13:40 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:13:40 user nova-compute[74889]:       <mac address="fa:16:3e:6d:f9:cc"/>
Nov 10 12:13:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:13:40 user nova-compute[74889]:       <target dev="tapccd32963-90"/>
Nov 10 12:13:40 user nova-compute[74889]:     </interface>
Nov 10 12:13:40 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:13:40 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/6d20b9d9-dfdd-4432-bb91-3bb6d6a905de/console.log" append="off"/>
Nov 10 12:13:40 user nova-compute[74889]:     </serial>
Nov 10 12:13:40 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:13:40 user nova-compute[74889]:     <video>
Nov 10 12:13:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:13:40 user nova-compute[74889]:     </video>
Nov 10 12:13:40 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:13:40 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:13:40 user nova-compute[74889]:     </rng>
Nov 10 12:13:40 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:13:40 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:13:40 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:13:40 user nova-compute[74889]:     </memballoon>
Nov 10 12:13:40 user nova-compute[74889]:   </devices>
Nov 10 12:13:40 user nova-compute[74889]: </domain>
Nov 10 12:13:40 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:81:7e,bridge_name='br-int',has_traffic_filtering=True,id=c48dd5ca-ff1b-43d2-aa2b-28876a27b698,network=Network(aa578c0e-96d4-458e-ab66-c50d2934261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48dd5ca-ff') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:81:7e,bridge_name='br-int',has_traffic_filtering=True,id=c48dd5ca-ff1b-43d2-aa2b-28876a27b698,network=Network(aa578c0e-96d4-458e-ab66-c50d2934261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48dd5ca-ff') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52a742aa-8c78-5828-9401-dd7f1c45a342', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc48dd5ca-ff, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc48dd5ca-ff, col_values=(('qos', UUID('8dd634d2-1862-481e-9aa6-0295ae98ea0f')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc48dd5ca-ff, col_values=(('external_ids', {'iface-id': 'c48dd5ca-ff1b-43d2-aa2b-28876a27b698', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:81:7e', 'vm-uuid': '6d20b9d9-dfdd-4432-bb91-3bb6d6a905de'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: INFO os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:81:7e,bridge_name='br-int',has_traffic_filtering=True,id=c48dd5ca-ff1b-43d2-aa2b-28876a27b698,network=Network(aa578c0e-96d4-458e-ab66-c50d2934261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48dd5ca-ff')
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3b:14,bridge_name='br-int',has_traffic_filtering=True,id=ad634c53-9335-4a00-8976-d6f66f2462fc,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad634c53-93') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3b:14,bridge_name='br-int',has_traffic_filtering=True,id=ad634c53-9335-4a00-8976-d6f66f2462fc,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad634c53-93') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9dc6aaaa-4949-59fd-8bdf-a46ddc591bdb', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad634c53-93, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad634c53-93, col_values=(('qos', UUID('0dfddd9b-488b-4ef6-9c36-9ab6337dffd9')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad634c53-93, col_values=(('external_ids', {'iface-id': 'ad634c53-9335-4a00-8976-d6f66f2462fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:3b:14', 'vm-uuid': '6d20b9d9-dfdd-4432-bb91-3bb6d6a905de'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: INFO os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3b:14,bridge_name='br-int',has_traffic_filtering=True,id=ad634c53-9335-4a00-8976-d6f66f2462fc,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad634c53-93')
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:58:29,bridge_name='br-int',has_traffic_filtering=True,id=bd0d21a9-d10e-4de0-9348-74adff8baad3,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd0d21a9-d1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:58:29,bridge_name='br-int',has_traffic_filtering=True,id=bd0d21a9-d10e-4de0-9348-74adff8baad3,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd0d21a9-d1') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1848f42f-87f3-556b-99ff-f79692354df6', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd0d21a9-d1, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd0d21a9-d1, col_values=(('qos', UUID('eb54ef40-5ea4-4ed2-99a6-9c2203d57b4e')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd0d21a9-d1, col_values=(('external_ids', {'iface-id': 'bd0d21a9-d10e-4de0-9348-74adff8baad3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:58:29', 'vm-uuid': '6d20b9d9-dfdd-4432-bb91-3bb6d6a905de'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: INFO os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:58:29,bridge_name='br-int',has_traffic_filtering=True,id=bd0d21a9-d10e-4de0-9348-74adff8baad3,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd0d21a9-d1')
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:43:52,bridge_name='br-int',has_traffic_filtering=True,id=d36952a8-d18b-4234-9829-3160f2e1882e,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36952a8-d1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:43:52,bridge_name='br-int',has_traffic_filtering=True,id=d36952a8-d18b-4234-9829-3160f2e1882e,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36952a8-d1') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2380fef-272c-5ccd-857f-21c00f1e77a8', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd36952a8-d1, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd36952a8-d1, col_values=(('qos', UUID('2b5bd0fc-ac26-4d1f-b1d0-8749bbb4362a')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd36952a8-d1, col_values=(('external_ids', {'iface-id': 'd36952a8-d18b-4234-9829-3160f2e1882e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:43:52', 'vm-uuid': '6d20b9d9-dfdd-4432-bb91-3bb6d6a905de'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: INFO os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:43:52,bridge_name='br-int',has_traffic_filtering=True,id=d36952a8-d18b-4234-9829-3160f2e1882e,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36952a8-d1')
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=65117c96-c353-458c-9df6-48237186ca2d,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65117c96-c3') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=65117c96-c353-458c-9df6-48237186ca2d,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65117c96-c3') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6187d5ca-6730-586d-9f82-2139a9deaf2c', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65117c96-c3, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65117c96-c3, col_values=(('qos', UUID('9b409d83-5906-4aaf-946f-962d607002d5')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65117c96-c3, col_values=(('external_ids', {'iface-id': '65117c96-c353-458c-9df6-48237186ca2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:b7:fd', 'vm-uuid': '6d20b9d9-dfdd-4432-bb91-3bb6d6a905de'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: INFO os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=65117c96-c353-458c-9df6-48237186ca2d,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65117c96-c3')
Nov 10 12:13:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:8e:05,bridge_name='br-int',has_traffic_filtering=True,id=57ea1ebe-c6fa-4cee-9718-db0369133dc2,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ea1ebe-c6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:8e:05,bridge_name='br-int',has_traffic_filtering=True,id=57ea1ebe-c6fa-4cee-9718-db0369133dc2,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ea1ebe-c6') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0880f5aa-c983-5ad7-aed8-dfc4f1da75f2', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57ea1ebe-c6, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57ea1ebe-c6, col_values=(('qos', UUID('5b23d861-dc78-4b6a-afe8-0995b8aaf676')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57ea1ebe-c6, col_values=(('external_ids', {'iface-id': '57ea1ebe-c6fa-4cee-9718-db0369133dc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:8e:05', 'vm-uuid': '6d20b9d9-dfdd-4432-bb91-3bb6d6a905de'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: INFO os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:8e:05,bridge_name='br-int',has_traffic_filtering=True,id=57ea1ebe-c6fa-4cee-9718-db0369133dc2,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ea1ebe-c6')
Nov 10 12:13:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=ccd32963-90a4-40ee-8d7e-e9896a20483c,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd32963-90') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=ccd32963-90a4-40ee-8d7e-e9896a20483c,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd32963-90') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea1fbde7-5c70-5332-97e3-7144af53393c', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccd32963-90, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccd32963-90, col_values=(('qos', UUID('87902e61-bee3-486f-9700-198481807a72')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccd32963-90, col_values=(('external_ids', {'iface-id': 'ccd32963-90a4-40ee-8d7e-e9896a20483c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:f9:cc', 'vm-uuid': '6d20b9d9-dfdd-4432-bb91-3bb6d6a905de'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:41 user nova-compute[74889]: INFO os_vif [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=ccd32963-90a4-40ee-8d7e-e9896a20483c,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd32963-90')
Nov 10 12:13:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] No BDM found with device name hda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] No VIF found with MAC fa:16:3e:8b:81:7e, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] No VIF found with MAC fa:16:3e:53:b7:fd, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:13:41 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Using config drive
Nov 10 12:13:41 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Creating config drive at /opt/stack/data/nova/instances/6d20b9d9-dfdd-4432-bb91-3bb6d6a905de/disk.config
Nov 10 12:13:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6d20b9d9-dfdd-4432-bb91-3bb6d6a905de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxdfmcwyk {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:41 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6d20b9d9-dfdd-4432-bb91-3bb6d6a905de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxdfmcwyk" returned: 0 in 0.059s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-1b24b48a-37c2-448a-ab84-0b37ae642a33 req-fcb91be2-9f5b-46bf-b151-f44549936d3a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1b24b48a-37c2-448a-ab84-0b37ae642a33 req-fcb91be2-9f5b-46bf-b151-f44549936d3a service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1b24b48a-37c2-448a-ab84-0b37ae642a33 req-fcb91be2-9f5b-46bf-b151-f44549936d3a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1b24b48a-37c2-448a-ab84-0b37ae642a33 req-fcb91be2-9f5b-46bf-b151-f44549936d3a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-1b24b48a-37c2-448a-ab84-0b37ae642a33 req-fcb91be2-9f5b-46bf-b151-f44549936d3a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:43 user nova-compute[74889]: WARNING nova.compute.manager [req-1b24b48a-37c2-448a-ab84-0b37ae642a33 req-fcb91be2-9f5b-46bf-b151-f44549936d3a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 for instance with vm_state building and task_state spawning.
Nov 10 12:13:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-85c346b8-f80a-46b7-8bc9-58e051724640 req-4eb73a85-6a13-4eaf-8c67-ad5811523c9b service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-85c346b8-f80a-46b7-8bc9-58e051724640 req-4eb73a85-6a13-4eaf-8c67-ad5811523c9b service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-85c346b8-f80a-46b7-8bc9-58e051724640 req-4eb73a85-6a13-4eaf-8c67-ad5811523c9b service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-85c346b8-f80a-46b7-8bc9-58e051724640 req-4eb73a85-6a13-4eaf-8c67-ad5811523c9b service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-85c346b8-f80a-46b7-8bc9-58e051724640 req-4eb73a85-6a13-4eaf-8c67-ad5811523c9b service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:44 user nova-compute[74889]: WARNING nova.compute.manager [req-85c346b8-f80a-46b7-8bc9-58e051724640 req-4eb73a85-6a13-4eaf-8c67-ad5811523c9b service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 for instance with vm_state building and task_state spawning.
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-c0c142e7-ebb2-4126-81fe-cff9603ebf08 req-2099b630-9ad5-49cb-8364-0a87c535a0c5 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c0c142e7-ebb2-4126-81fe-cff9603ebf08 req-2099b630-9ad5-49cb-8364-0a87c535a0c5 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c0c142e7-ebb2-4126-81fe-cff9603ebf08 req-2099b630-9ad5-49cb-8364-0a87c535a0c5 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c0c142e7-ebb2-4126-81fe-cff9603ebf08 req-2099b630-9ad5-49cb-8364-0a87c535a0c5 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG nova.compute.manager [req-c0c142e7-ebb2-4126-81fe-cff9603ebf08 req-2099b630-9ad5-49cb-8364-0a87c535a0c5 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:44 user nova-compute[74889]: WARNING nova.compute.manager [req-c0c142e7-ebb2-4126-81fe-cff9603ebf08 req-2099b630-9ad5-49cb-8364-0a87c535a0c5 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-d36952a8-d18b-4234-9829-3160f2e1882e for instance with vm_state building and task_state spawning.
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:45 user nova-compute[74889]: WARNING nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 for instance with vm_state building and task_state spawning.
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:45 user nova-compute[74889]: WARNING nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-ad634c53-9335-4a00-8976-d6f66f2462fc for instance with vm_state building and task_state spawning.
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:45 user nova-compute[74889]: WARNING nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-ad634c53-9335-4a00-8976-d6f66f2462fc for instance with vm_state building and task_state spawning.
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:45 user nova-compute[74889]: WARNING nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-65117c96-c353-458c-9df6-48237186ca2d for instance with vm_state building and task_state spawning.
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:45 user nova-compute[74889]: WARNING nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-65117c96-c353-458c-9df6-48237186ca2d for instance with vm_state building and task_state spawning.
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:45 user nova-compute[74889]: WARNING nova.compute.manager [req-54dd6f83-2e46-4b2f-a2a9-f6c3cfabc10e req-49aa2ba0-e5bc-47f3-890a-01608617f53a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 for instance with vm_state building and task_state spawning.
Nov 10 12:13:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:46 user nova-compute[74889]: WARNING nova.compute.manager [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 for instance with vm_state building and task_state spawning.
Nov 10 12:13:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:46 user nova-compute[74889]: WARNING nova.compute.manager [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-ccd32963-90a4-40ee-8d7e-e9896a20483c for instance with vm_state building and task_state spawning.
Nov 10 12:13:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:46 user nova-compute[74889]: WARNING nova.compute.manager [req-630d02a3-0022-4f79-a0d8-50abbaa8b4cd req-d61c769e-83bd-4f49-9fbf-8c99dcb176b9 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-ccd32963-90a4-40ee-8d7e-e9896a20483c for instance with vm_state building and task_state spawning.
Nov 10 12:13:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-28e5ba5b-708b-4c05-8442-ede24bffd4cf req-6aaab510-a77f-4a99-8dac-1772ed9eddf7 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-28e5ba5b-708b-4c05-8442-ede24bffd4cf req-6aaab510-a77f-4a99-8dac-1772ed9eddf7 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-28e5ba5b-708b-4c05-8442-ede24bffd4cf req-6aaab510-a77f-4a99-8dac-1772ed9eddf7 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-28e5ba5b-708b-4c05-8442-ede24bffd4cf req-6aaab510-a77f-4a99-8dac-1772ed9eddf7 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-28e5ba5b-708b-4c05-8442-ede24bffd4cf req-6aaab510-a77f-4a99-8dac-1772ed9eddf7 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:46 user nova-compute[74889]: WARNING nova.compute.manager [req-28e5ba5b-708b-4c05-8442-ede24bffd4cf req-6aaab510-a77f-4a99-8dac-1772ed9eddf7 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-d36952a8-d18b-4234-9829-3160f2e1882e for instance with vm_state building and task_state spawning.
Nov 10 12:13:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-9f0f32cb-a0b5-481c-ab89-127a52a0870a req-fe382995-67d7-46ff-bf74-57910f07be59 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f0f32cb-a0b5-481c-ab89-127a52a0870a req-fe382995-67d7-46ff-bf74-57910f07be59 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f0f32cb-a0b5-481c-ab89-127a52a0870a req-fe382995-67d7-46ff-bf74-57910f07be59 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f0f32cb-a0b5-481c-ab89-127a52a0870a req-fe382995-67d7-46ff-bf74-57910f07be59 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-9f0f32cb-a0b5-481c-ab89-127a52a0870a req-fe382995-67d7-46ff-bf74-57910f07be59 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:13:47 user nova-compute[74889]: WARNING nova.compute.manager [req-9f0f32cb-a0b5-481c-ab89-127a52a0870a req-fe382995-67d7-46ff-bf74-57910f07be59 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 for instance with vm_state building and task_state spawning.
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:13:47 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance spawned successfully.
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:13:47 user nova-compute[74889]: INFO nova.compute.manager [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Took 12.63 seconds to spawn the instance on the hypervisor.
Nov 10 12:13:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:13:47 user nova-compute[74889]: INFO nova.compute.manager [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Took 145.01 seconds to build instance.
Nov 10 12:13:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e93f01fe-6d00-4468-a64a-a146979510d8 tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 145.145s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:50 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:13:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:13:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:13:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:13:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:13:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:13:53 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updating instance_info_cache with network_info: [{"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:13:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:13:56 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:13:56 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8125MB free_disk=25.338218688964844GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 84d76753-0cf2-4444-a6fa-9a9500b769fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance dd45343e-ffad-435a-83da-ad9c64fba838 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 8ff94e81-7325-436e-9c48-f2e7dceb06b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:13:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:13:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:14:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:14:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:14:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:14:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:14:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:14:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:14:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:14:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETzxUPuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:14:12 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:14:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:14:12 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:14:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:14:12 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:14:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[452a4d96-7dd0-459f-ab48-d741e29bd9b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:14:12 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a6b9a0-b10a-426a-9590-df7d53daaac5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28] added
Nov 10 12:14:12 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d983279-fc4b-4deb-9944-1ae82385225d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[029e2c53-db06-4ac8-a115-a7c542a57cb9]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETzxUPuA {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ETzxUPuA" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f67979a-86f6-4238-b86e-27f2f710596e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ETzxUPuA'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[20978096-cd52-4457-83fb-3152adea9bc0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fe125d-9454-4f24-9e46-ec9af2501dfd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba9568d-6b2f-4955-99d2-b4cbdc6eea60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28, portal: 172.16.0.220,3260]
Nov 10 12:14:13 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28, portal: 172.16.0.220,3260] successful.
Nov 10 12:14:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b558c6-f020-49a1-abc4-5e298ecbd033]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[519154b1-a9a5-490e-8cb0-2e3850dc39cc]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 (non-flash)
Nov 10 12:14:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] HCTL ('38', '-', '-', 0) found on session 43 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c32796b-f12e-4e41-a8ab-05caadb4e924]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:14:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETzxUPuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:14:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:14:14 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26436633261333430', 'path': '/dev/sdg'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:14:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436633261333430', 'path': '/dev/sdg'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:14:14 user nova-compute[74889]: DEBUG nova.objects.instance [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'flavor' on Instance uuid dd45343e-ffad-435a-83da-ad9c64fba838 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:14:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:14:14 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:14:14 user nova-compute[74889]:   <source dev="/dev/sdg"/>
Nov 10 12:14:14 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:14:14 user nova-compute[74889]:   <serial>46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28</serial>
Nov 10 12:14:14 user nova-compute[74889]: </disk>
Nov 10 12:14:14 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:14:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:14:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:14:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] No VIF found with MAC fa:16:3e:34:79:6f, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:14:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-86998343-c786-4572-97d7-0d6cfd91b5c7 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 39.538s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "dd45343e-ffad-435a-83da-ad9c64fba838" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:15 user nova-compute[74889]: INFO nova.compute.manager [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Detaching volume 46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28
Nov 10 12:14:15 user nova-compute[74889]: INFO nova.virt.block_device [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Attempting to driver detach volume 46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 from mountpoint /dev/vdb
Nov 10 12:14:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Attempting to detach device vdb from instance dd45343e-ffad-435a-83da-ad9c64fba838 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:14:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:14:15 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:14:15 user nova-compute[74889]:   <source dev="/dev/sdg"/>
Nov 10 12:14:15 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:14:15 user nova-compute[74889]:   <serial>46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28</serial>
Nov 10 12:14:15 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:14:15 user nova-compute[74889]: </disk>
Nov 10 12:14:15 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:14:15 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully detached device vdb from instance dd45343e-ffad-435a-83da-ad9c64fba838 from the persistent domain config.
Nov 10 12:14:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd45343e-ffad-435a-83da-ad9c64fba838 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:14:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:14:15 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:14:15 user nova-compute[74889]:   <source dev="/dev/sdg"/>
Nov 10 12:14:15 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:14:15 user nova-compute[74889]:   <serial>46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28</serial>
Nov 10 12:14:15 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:14:15 user nova-compute[74889]: </disk>
Nov 10 12:14:15 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:14:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd45343e-ffad-435a-83da-ad9c64fba838 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:14:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:26 user nova-compute[74889]: INFO nova.compute.manager [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Detaching volume 062180dc-ad09-4bf0-a710-58a76fd66e4f
Nov 10 12:14:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:26 user nova-compute[74889]: INFO nova.virt.block_device [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Attempting to driver detach volume 062180dc-ad09-4bf0-a710-58a76fd66e4f from mountpoint /dev/vdb
Nov 10 12:14:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Attempting to detach device vdb from instance 84d76753-0cf2-4444-a6fa-9a9500b769fe from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:14:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:14:26 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:14:26 user nova-compute[74889]:   <source dev="/dev/sdc"/>
Nov 10 12:14:26 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:14:26 user nova-compute[74889]:   <serial>062180dc-ad09-4bf0-a710-58a76fd66e4f</serial>
Nov 10 12:14:26 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:14:26 user nova-compute[74889]: </disk>
Nov 10 12:14:26 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:14:26 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Successfully detached device vdb from instance 84d76753-0cf2-4444-a6fa-9a9500b769fe from the persistent domain config.
Nov 10 12:14:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84d76753-0cf2-4444-a6fa-9a9500b769fe from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:14:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:14:26 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:14:26 user nova-compute[74889]:   <source dev="/dev/sdc"/>
Nov 10 12:14:26 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:14:26 user nova-compute[74889]:   <serial>062180dc-ad09-4bf0-a710-58a76fd66e4f</serial>
Nov 10 12:14:26 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:14:26 user nova-compute[74889]: </disk>
Nov 10 12:14:26 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:14:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84d76753-0cf2-4444-a6fa-9a9500b769fe {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:14:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-65212b5a-a97e-4117-90e4-95b3f66a8b91 req-e316ad60-9a2b-4474-95cc-7eb804dd1770 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received event network-changed-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-65212b5a-a97e-4117-90e4-95b3f66a8b91 req-e316ad60-9a2b-4474-95cc-7eb804dd1770 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Refreshing instance network info cache due to event network-changed-d92219a7-7d86-4ab8-8e34-d6cd136eb818. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:14:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-65212b5a-a97e-4117-90e4-95b3f66a8b91 req-e316ad60-9a2b-4474-95cc-7eb804dd1770 service nova] Acquiring lock "refresh_cache-8ff94e81-7325-436e-9c48-f2e7dceb06b2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:14:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-65212b5a-a97e-4117-90e4-95b3f66a8b91 req-e316ad60-9a2b-4474-95cc-7eb804dd1770 service nova] Acquired lock "refresh_cache-8ff94e81-7325-436e-9c48-f2e7dceb06b2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:14:34 user nova-compute[74889]: DEBUG nova.network.neutron [req-65212b5a-a97e-4117-90e4-95b3f66a8b91 req-e316ad60-9a2b-4474-95cc-7eb804dd1770 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Refreshing network info cache for port d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:14:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-65212b5a-a97e-4117-90e4-95b3f66a8b91 req-e316ad60-9a2b-4474-95cc-7eb804dd1770 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Updated VIF entry in instance network info cache for port d92219a7-7d86-4ab8-8e34-d6cd136eb818. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:14:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-65212b5a-a97e-4117-90e4-95b3f66a8b91 req-e316ad60-9a2b-4474-95cc-7eb804dd1770 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Updating instance_info_cache with network_info: [{"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:14:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-65212b5a-a97e-4117-90e4-95b3f66a8b91 req-e316ad60-9a2b-4474-95cc-7eb804dd1770 service nova] Releasing lock "refresh_cache-8ff94e81-7325-436e-9c48-f2e7dceb06b2" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:14:36 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd45343e-ffad-435a-83da-ad9c64fba838 is timed out.
Nov 10 12:14:36 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully detached device vdb from instance dd45343e-ffad-435a-83da-ad9c64fba838 from the live domain config.
Nov 10 12:14:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ETzxUPuA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:14:36 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d6a78-0f92-47d4-9773-acac872a29fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:14:36 user nova-compute[74889]: No targets found.
Nov 10 12:14:36 user nova-compute[74889]: iSNS:
Nov 10 12:14:36 user nova-compute[74889]: No targets found.
Nov 10 12:14:36 user nova-compute[74889]: STATIC:
Nov 10 12:14:36 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42
Nov 10 12:14:36 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:36 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:36 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f
Nov 10 12:14:36 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:36 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:36 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28
Nov 10 12:14:36 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:36 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:36 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0
Nov 10 12:14:36 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:36 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:36 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897
Nov 10 12:14:36 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:36 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:36 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c
Nov 10 12:14:36 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:36 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:36 user nova-compute[74889]: FIRMWARE:
Nov 10 12:14:36 user nova-compute[74889]: No targets found.
Nov 10 12:14:36 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:14:36 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:14:36 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bcd7be-3195-4b7d-8e7d-f56197dfe14e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[530d5bd8-ca85-4c50-9d5f-26857364badf]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:14:36 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:14:36 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:36 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:36 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:36 user nova-compute[74889]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 (non-flash)
Nov 10 12:14:36 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:14:36 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:14:36 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:36 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:36 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:36 user nova-compute[74889]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 (non-flash)
Nov 10 12:14:36 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3885630a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28'): ({'sdg'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Removing single pathed devices sdg {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[612dd5a4-56a5-4287-b9c2-ea353ce1125b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a374ca3-f45f-4219-9c02-b6b29c87f4dc]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Flushing IO for device /dev/sdg {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b670f0-41c2-4561-8029-633fff0c7a87]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f18fe3e-c92a-48d2-816e-9b3d0c1b1225]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] SCSI volumes sdg have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2368185b-d166-4551-96fb-78f22fd58fd4]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e2f4ed-1ba6-41bb-8067-d72b05137843]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28, portal: 172.16.0.220,3260]
Nov 10 12:14:36 user nova-compute[74889]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28, portal: 172.16.0.220,3260] successful.
Nov 10 12:14:36 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46a3fb96-dd10-4dd3-9df9-0a3a1ddb2f28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b386a72-5fdd-4703-b8c2-2099aa367db2]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] <== disconnect_volume: return (336ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:36 user nova-compute[74889]: INFO nova.compute.manager [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Terminating instance
Nov 10 12:14:36 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-ea193f4d-e4da-408f-9647-0c5fafb59f3c req-001c98cd-b0c0-4760-ae1f-c082b6c19823 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received event network-vif-unplugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ea193f4d-e4da-408f-9647-0c5fafb59f3c req-001c98cd-b0c0-4760-ae1f-c082b6c19823 service nova] Acquiring lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ea193f4d-e4da-408f-9647-0c5fafb59f3c req-001c98cd-b0c0-4760-ae1f-c082b6c19823 service nova] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ea193f4d-e4da-408f-9647-0c5fafb59f3c req-001c98cd-b0c0-4760-ae1f-c082b6c19823 service nova] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-ea193f4d-e4da-408f-9647-0c5fafb59f3c req-001c98cd-b0c0-4760-ae1f-c082b6c19823 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] No waiting events found dispatching network-vif-unplugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:14:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-ea193f4d-e4da-408f-9647-0c5fafb59f3c req-001c98cd-b0c0-4760-ae1f-c082b6c19823 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received event network-vif-unplugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Instance destroyed successfully.
Nov 10 12:14:37 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lazy-loading 'resources' on Instance uuid 8ff94e81-7325-436e-9c48-f2e7dceb06b2 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:12:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2120175791',display_name='tempest-TestVolumeBootPattern-server-2120175791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2120175791',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5sI8i7f1ePG/W7UaO+8+gsVMkmIp2O9S2Zp/OA7rnj2vqp7KJJD0civJv0L7iUGqDlP4rsFJ2tgFLkt5XPKycZVXji+0bjZyXuGwJUvRKhSllkY2ECb15wAksxQrkIeg==',key_name='tempest-TestVolumeBootPattern-597466952',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-uex36myz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:13:16Z,user_data=None,user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=8ff94e81-7325-436e-9c48-f2e7dceb06b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "address": "fa:16:3e:15:98:d1", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd92219a7-7d", "ovs_interfaceid": "d92219a7-7d86-4ab8-8e34-d6cd136eb818", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:98:d1,bridge_name='br-int',has_traffic_filtering=True,id=d92219a7-7d86-4ab8-8e34-d6cd136eb818,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92219a7-7d') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_vif [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:98:d1,bridge_name='br-int',has_traffic_filtering=True,id=d92219a7-7d86-4ab8-8e34-d6cd136eb818,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92219a7-7d') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'flavor' on Instance uuid dd45343e-ffad-435a-83da-ad9c64fba838 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd92219a7-7d, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c343ba54-b1e8-42ae-a780-0065d1f46a25) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:37 user nova-compute[74889]: INFO os_vif [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:98:d1,bridge_name='br-int',has_traffic_filtering=True,id=d92219a7-7d86-4ab8-8e34-d6cd136eb818,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd92219a7-7d')
Nov 10 12:14:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjutlEDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:14:37 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f8164959-ef2e-4e3c-a250-9698fa458848 tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.039s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af919ff-22b2-4ee1-8e04-5a4b0d0de839]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:14:37 user nova-compute[74889]: No targets found.
Nov 10 12:14:37 user nova-compute[74889]: iSNS:
Nov 10 12:14:37 user nova-compute[74889]: No targets found.
Nov 10 12:14:37 user nova-compute[74889]: STATIC:
Nov 10 12:14:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42
Nov 10 12:14:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f
Nov 10 12:14:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0
Nov 10 12:14:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897
Nov 10 12:14:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c
Nov 10 12:14:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:37 user nova-compute[74889]: FIRMWARE:
Nov 10 12:14:37 user nova-compute[74889]: No targets found.
Nov 10 12:14:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:14:37 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:14:37 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[90061ec8-7fcb-4f1d-b175-2e9ba67747ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63aba7e-4df4-48e6-9902-e8f199a03ad7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:14:37 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:14:37 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:37 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:37 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:14:37 user nova-compute[74889]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:14:37 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:37 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:37 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398204040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b5eeac-371e-404c-ad99-c3e5c40badc5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1e4981-cc0d-4749-b4fb-e3f6558ec3e3]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[10330974-8fcc-4795-8f9b-c1599a3a920b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85bda89-cb8e-40a2-8c95-4cdbbd6992ec]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5194d2-88b7-4684-83b8-544244825338]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d761303-be01-4c15-baab-bebee67202ad]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260]
Nov 10 12:14:37 user nova-compute[74889]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260] successful.
Nov 10 12:14:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5e12b0-5df8-4397-85c4-2670609201c0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== disconnect_volume: return (339ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:14:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Deleting instance files /opt/stack/data/nova/instances/8ff94e81-7325-436e-9c48-f2e7dceb06b2_del
Nov 10 12:14:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Deletion of /opt/stack/data/nova/instances/8ff94e81-7325-436e-9c48-f2e7dceb06b2_del complete
Nov 10 12:14:37 user nova-compute[74889]: INFO nova.compute.manager [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 10 12:14:37 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:14:37 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:14:38 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:14:38 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Took 0.82 seconds to deallocate network for instance.
Nov 10 12:14:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-60de5e51-07a4-4e21-89c3-ee063b13b1fa req-6f5fc381-a205-45f9-96ff-1cd3d07eac3a service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received event network-vif-deleted-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:38 user nova-compute[74889]: INFO nova.compute.manager [req-60de5e51-07a4-4e21-89c3-ee063b13b1fa req-6f5fc381-a205-45f9-96ff-1cd3d07eac3a service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Neutron deleted interface d92219a7-7d86-4ab8-8e34-d6cd136eb818; detaching it from the instance and deleting it from the info cache
Nov 10 12:14:38 user nova-compute[74889]: DEBUG nova.network.neutron [req-60de5e51-07a4-4e21-89c3-ee063b13b1fa req-6f5fc381-a205-45f9-96ff-1cd3d07eac3a service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:14:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-60de5e51-07a4-4e21-89c3-ee063b13b1fa req-6f5fc381-a205-45f9-96ff-1cd3d07eac3a service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Detach interface failed, port_id=d92219a7-7d86-4ab8-8e34-d6cd136eb818, reason: Instance 8ff94e81-7325-436e-9c48-f2e7dceb06b2 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:14:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-968555e6-22a7-42c1-b9cd-3f781085edcf req-6f16a0ae-401d-4ffa-b116-a75be5877788 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received event network-vif-plugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-968555e6-22a7-42c1-b9cd-3f781085edcf req-6f16a0ae-401d-4ffa-b116-a75be5877788 service nova] Acquiring lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-968555e6-22a7-42c1-b9cd-3f781085edcf req-6f16a0ae-401d-4ffa-b116-a75be5877788 service nova] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-968555e6-22a7-42c1-b9cd-3f781085edcf req-6f16a0ae-401d-4ffa-b116-a75be5877788 service nova] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-968555e6-22a7-42c1-b9cd-3f781085edcf req-6f16a0ae-401d-4ffa-b116-a75be5877788 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] No waiting events found dispatching network-vif-plugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:14:38 user nova-compute[74889]: WARNING nova.compute.manager [req-968555e6-22a7-42c1-b9cd-3f781085edcf req-6f16a0ae-401d-4ffa-b116-a75be5877788 service nova] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Received unexpected event network-vif-plugged-d92219a7-7d86-4ab8-8e34-d6cd136eb818 for instance with vm_state active and task_state deleting.
Nov 10 12:14:39 user nova-compute[74889]: INFO nova.compute.manager [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 8ff94e81-7325-436e-9c48-f2e7dceb06b2] Took 0.96 seconds to detach 1 volumes for instance.
Nov 10 12:14:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:39 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:14:39 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:14:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:39 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Deleted allocations for instance 8ff94e81-7325-436e-9c48-f2e7dceb06b2
Nov 10 12:14:40 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a7e13f1-eb61-4241-ba4a-a396c920fe2b tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "8ff94e81-7325-436e-9c48-f2e7dceb06b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.456s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:46 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 84d76753-0cf2-4444-a6fa-9a9500b769fe is timed out.
Nov 10 12:14:46 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Successfully detached device vdb from instance 84d76753-0cf2-4444-a6fa-9a9500b769fe from the live domain config.
Nov 10 12:14:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:14:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPwsEvGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:14:46 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:14:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:14:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:14:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05f06a8-4f9c-43f4-9026-b15fee374713]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:14:46 user nova-compute[74889]: No targets found.
Nov 10 12:14:46 user nova-compute[74889]: iSNS:
Nov 10 12:14:46 user nova-compute[74889]: No targets found.
Nov 10 12:14:46 user nova-compute[74889]: STATIC:
Nov 10 12:14:46 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42
Nov 10 12:14:46 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:46 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:46 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f
Nov 10 12:14:46 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:46 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:46 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0
Nov 10 12:14:46 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:46 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:46 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897
Nov 10 12:14:46 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:46 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:46 user nova-compute[74889]: FIRMWARE:
Nov 10 12:14:46 user nova-compute[74889]: No targets found.
Nov 10 12:14:46 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:14:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:14:46 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:14:46 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:14:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:14:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1564cd8-92cb-4d64-b41b-936504278bd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce48364-6015-4ac5-9cf6-93d2b248a398]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:14:47 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:47 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:47 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:47 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f (non-flash)
Nov 10 12:14:47 user nova-compute[74889]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:47 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:47 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:47 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a03d4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f'): ({'sdc'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Removing single pathed devices sdc {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[23956eb8-fb79-49cc-97a6-45b398431aaf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f3d9da-97ae-4a4b-a1d9-2a3a8dbd634b]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Flushing IO for device /dev/sdc {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9495964b-673a-4918-861b-89edd23d6557]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8d900-6194-4701-8a7f-359c637b0b01]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa82233-4305-42db-9301-9786ad643742]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a4d5c1-c2be-47db-84ac-fee2fbc73838]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f, portal: 172.16.0.220,3260]
Nov 10 12:14:47 user nova-compute[74889]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f, portal: 172.16.0.220,3260] successful.
Nov 10 12:14:47 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ea344-4b46-4ac4-9808-6a25365b3c5f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] <== disconnect_volume: return (295ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:14:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:48 user nova-compute[74889]: DEBUG nova.objects.instance [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lazy-loading 'flavor' on Instance uuid 84d76753-0cf2-4444-a6fa-9a9500b769fe {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:14:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a1275117-7b9f-4d5c-b3d2-e062b845f91e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.497s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.351s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:48 user nova-compute[74889]: INFO nova.compute.manager [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Terminating instance
Nov 10 12:14:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:14:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-3fab5134-31ea-4f3a-8a87-d9eeee847bfb req-14c1cf36-c4f4-425d-9714-27904d51f320 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received event network-vif-unplugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3fab5134-31ea-4f3a-8a87-d9eeee847bfb req-14c1cf36-c4f4-425d-9714-27904d51f320 service nova] Acquiring lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3fab5134-31ea-4f3a-8a87-d9eeee847bfb req-14c1cf36-c4f4-425d-9714-27904d51f320 service nova] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3fab5134-31ea-4f3a-8a87-d9eeee847bfb req-14c1cf36-c4f4-425d-9714-27904d51f320 service nova] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-3fab5134-31ea-4f3a-8a87-d9eeee847bfb req-14c1cf36-c4f4-425d-9714-27904d51f320 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] No waiting events found dispatching network-vif-unplugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-3fab5134-31ea-4f3a-8a87-d9eeee847bfb req-14c1cf36-c4f4-425d-9714-27904d51f320 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received event network-vif-unplugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:14:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Instance destroyed successfully.
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lazy-loading 'resources' on Instance uuid 84d76753-0cf2-4444-a6fa-9a9500b769fe {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1001605610',display_name='tempest-VolumesSnapshotTestJSON-instance-1001605610',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1001605610',id=33,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdu3e5E6+bpzW0z9QuVfBt71fhcnjMOHhan37/S1iP3bL+S/IR6TDAZAuQqVunHYAZfypAhjGSHJpQ87mc+cCq08SPLocnYEloFdrwnHbFiEdWSlX1KuI1hs2ZaTziyrA==',key_name='tempest-keypair-654924453',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:11:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a044fadd3c4420e8eedda7501a12114',ramdisk_id='',reservation_id='r-kjgxtn87',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2146398887',owner_user_name='tempest-VolumesSnapshotTestJSON-2146398887-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:11:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='109e2f18063546d48270f3ae95fae53d',uuid=84d76753-0cf2-4444-a6fa-9a9500b769fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converting VIF {"id": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "address": "fa:16:3e:46:e7:68", "network": {"id": "caba1157-48d0-4cba-8a90-a461583f4061", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2104101525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a044fadd3c4420e8eedda7501a12114", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef4d2def-ac", "ovs_interfaceid": "ef4d2def-ac31-49a9-af55-c5f406b80a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=ef4d2def-ac31-49a9-af55-c5f406b80a7a,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4d2def-ac') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_vif [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=ef4d2def-ac31-49a9-af55-c5f406b80a7a,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4d2def-ac') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef4d2def-ac, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7423bdf2-f8cc-4896-afe2-1f9df9d80f18) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:14:49 user nova-compute[74889]: INFO os_vif [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:e7:68,bridge_name='br-int',has_traffic_filtering=True,id=ef4d2def-ac31-49a9-af55-c5f406b80a7a,network=Network(caba1157-48d0-4cba-8a90-a461583f4061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef4d2def-ac')
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mPwsEvGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:14:49 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[799c57c7-4738-4057-9015-7bbab25ac5a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:14:49 user nova-compute[74889]: No targets found.
Nov 10 12:14:49 user nova-compute[74889]: iSNS:
Nov 10 12:14:49 user nova-compute[74889]: No targets found.
Nov 10 12:14:49 user nova-compute[74889]: STATIC:
Nov 10 12:14:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42
Nov 10 12:14:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0
Nov 10 12:14:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897
Nov 10 12:14:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:14:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:14:49 user nova-compute[74889]: FIRMWARE:
Nov 10 12:14:49 user nova-compute[74889]: No targets found.
Nov 10 12:14:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:14:49 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:14:49 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:062180dc-ad09-4bf0-a710-58a76fd66e4f', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c85d4e-f545-4784-98ae-c409cc025375]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec82b43e-f2cc-40fa-b160-f42fdac365a3]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:49 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:49 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:14:49 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:14:49 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:14:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3884ee3b0>, {}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Disconnecting from: [] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] <== disconnect_volume: return (75ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:14:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Deleting instance files /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe_del
Nov 10 12:14:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Deletion of /opt/stack/data/nova/instances/84d76753-0cf2-4444-a6fa-9a9500b769fe_del complete
Nov 10 12:14:49 user nova-compute[74889]: INFO nova.compute.manager [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 10 12:14:49 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:14:49 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:14:50 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:14:50 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Took 0.99 seconds to deallocate network for instance.
Nov 10 12:14:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-dfc7fa27-20ca-4a5e-8863-cbf89c1873c1 req-8cfacf31-29a2-402b-afb0-918347e0c0b3 service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received event network-vif-deleted-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:50 user nova-compute[74889]: WARNING nova.volume.cinder [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Attachment 5a2988e6-9d5b-4aaf-9a45-061cbe879a35 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5a2988e6-9d5b-4aaf-9a45-061cbe879a35. (HTTP 404) (Request-ID: req-10e6227f-a1f8-4665-87aa-756332ca5cb5)
Nov 10 12:14:50 user nova-compute[74889]: INFO nova.compute.manager [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Took 0.03 seconds to detach 1 volumes for instance.
Nov 10 12:14:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:51 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:14:51 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:14:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:51 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Deleted allocations for instance 84d76753-0cf2-4444-a6fa-9a9500b769fe
Nov 10 12:14:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-48ab408c-17a5-4bbb-831d-e991604e7795 req-eb214b19-f125-4950-8070-e7667bc4928a service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received event network-vif-plugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-48ab408c-17a5-4bbb-831d-e991604e7795 req-eb214b19-f125-4950-8070-e7667bc4928a service nova] Acquiring lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-48ab408c-17a5-4bbb-831d-e991604e7795 req-eb214b19-f125-4950-8070-e7667bc4928a service nova] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-48ab408c-17a5-4bbb-831d-e991604e7795 req-eb214b19-f125-4950-8070-e7667bc4928a service nova] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-48ab408c-17a5-4bbb-831d-e991604e7795 req-eb214b19-f125-4950-8070-e7667bc4928a service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] No waiting events found dispatching network-vif-plugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:14:51 user nova-compute[74889]: WARNING nova.compute.manager [req-48ab408c-17a5-4bbb-831d-e991604e7795 req-eb214b19-f125-4950-8070-e7667bc4928a service nova] [instance: 84d76753-0cf2-4444-a6fa-9a9500b769fe] Received unexpected event network-vif-plugged-ef4d2def-ac31-49a9-af55-c5f406b80a7a for instance with vm_state deleted and task_state None.
Nov 10 12:14:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e55c11ab-7c12-4ae4-9eab-fee8c5aaa33e tempest-VolumesSnapshotTestJSON-2146398887 tempest-VolumesSnapshotTestJSON-2146398887-project-member] Lock "84d76753-0cf2-4444-a6fa-9a9500b769fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.400s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:14:51 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:14:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:54 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:14:55 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:14:55 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8323MB free_disk=25.363746643066406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance dd45343e-ffad-435a-83da-ad9c64fba838 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.manager [req-a97b23b3-c84e-4ceb-8335-1c6c6ac26106 req-56d67f06-a8ff-4d71-b0fb-e3ae4b6b858a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-changed-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.manager [req-a97b23b3-c84e-4ceb-8335-1c6c6ac26106 req-56d67f06-a8ff-4d71-b0fb-e3ae4b6b858a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing instance network info cache due to event network-changed-c48dd5ca-ff1b-43d2-aa2b-28876a27b698. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a97b23b3-c84e-4ceb-8335-1c6c6ac26106 req-56d67f06-a8ff-4d71-b0fb-e3ae4b6b858a service nova] Acquiring lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a97b23b3-c84e-4ceb-8335-1c6c6ac26106 req-56d67f06-a8ff-4d71-b0fb-e3ae4b6b858a service nova] Acquired lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.network.neutron [req-a97b23b3-c84e-4ceb-8335-1c6c6ac26106 req-56d67f06-a8ff-4d71-b0fb-e3ae4b6b858a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Refreshing network info cache for port c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:14:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:56 user nova-compute[74889]: DEBUG nova.network.neutron [req-a97b23b3-c84e-4ceb-8335-1c6c6ac26106 req-56d67f06-a8ff-4d71-b0fb-e3ae4b6b858a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updated VIF entry in instance network info cache for port c48dd5ca-ff1b-43d2-aa2b-28876a27b698. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:14:56 user nova-compute[74889]: DEBUG nova.network.neutron [req-a97b23b3-c84e-4ceb-8335-1c6c6ac26106 req-56d67f06-a8ff-4d71-b0fb-e3ae4b6b858a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [{"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:14:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a97b23b3-c84e-4ceb-8335-1c6c6ac26106 req-56d67f06-a8ff-4d71-b0fb-e3ae4b6b858a service nova] Releasing lock "refresh_cache-6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:14:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:14:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:14:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:14:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:14:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:14:57 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Updating instance_info_cache with network_info: [{"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:14:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-dd45343e-ffad-435a-83da-ad9c64fba838" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:14:57 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:14:57 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:14:57 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:14:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:57 user nova-compute[74889]: INFO nova.compute.manager [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Terminating instance
Nov 10 12:14:57 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-4ff80d1e-9fc2-4e44-8ba4-9c82a8abd39c req-0cb8d1a0-88ac-484c-a7cc-84c579b28513 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4ff80d1e-9fc2-4e44-8ba4-9c82a8abd39c req-0cb8d1a0-88ac-484c-a7cc-84c579b28513 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4ff80d1e-9fc2-4e44-8ba4-9c82a8abd39c req-0cb8d1a0-88ac-484c-a7cc-84c579b28513 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4ff80d1e-9fc2-4e44-8ba4-9c82a8abd39c req-0cb8d1a0-88ac-484c-a7cc-84c579b28513 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-4ff80d1e-9fc2-4e44-8ba4-9c82a8abd39c req-0cb8d1a0-88ac-484c-a7cc-84c579b28513 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-unplugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-4ff80d1e-9fc2-4e44-8ba4-9c82a8abd39c req-0cb8d1a0-88ac-484c-a7cc-84c579b28513 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-d920f4f5-db96-4740-b657-781ed5cf0111 req-690776c5-93bb-4f8e-b405-6588c2f0d362 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d920f4f5-db96-4740-b657-781ed5cf0111 req-690776c5-93bb-4f8e-b405-6588c2f0d362 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d920f4f5-db96-4740-b657-781ed5cf0111 req-690776c5-93bb-4f8e-b405-6588c2f0d362 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d920f4f5-db96-4740-b657-781ed5cf0111 req-690776c5-93bb-4f8e-b405-6588c2f0d362 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-d920f4f5-db96-4740-b657-781ed5cf0111 req-690776c5-93bb-4f8e-b405-6588c2f0d362 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-unplugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-d920f4f5-db96-4740-b657-781ed5cf0111 req-690776c5-93bb-4f8e-b405-6588c2f0d362 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-0f9c227d-4127-41b9-a120-0c0cc418d89c req-83cae71b-7a4f-4e2a-bc14-b14a744b479a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0f9c227d-4127-41b9-a120-0c0cc418d89c req-83cae71b-7a4f-4e2a-bc14-b14a744b479a service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0f9c227d-4127-41b9-a120-0c0cc418d89c req-83cae71b-7a4f-4e2a-bc14-b14a744b479a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0f9c227d-4127-41b9-a120-0c0cc418d89c req-83cae71b-7a4f-4e2a-bc14-b14a744b479a service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-0f9c227d-4127-41b9-a120-0c0cc418d89c req-83cae71b-7a4f-4e2a-bc14-b14a744b479a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-unplugged-d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-0f9c227d-4127-41b9-a120-0c0cc418d89c req-83cae71b-7a4f-4e2a-bc14-b14a744b479a service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-d36952a8-d18b-4234-9829-3160f2e1882e for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Instance destroyed successfully.
Nov 10 12:14:59 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lazy-loading 'resources' on Instance uuid 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:81:7e,bridge_name='br-int',has_traffic_filtering=True,id=c48dd5ca-ff1b-43d2-aa2b-28876a27b698,network=Network(aa578c0e-96d4-458e-ab66-c50d2934261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48dd5ca-ff') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:81:7e,bridge_name='br-int',has_traffic_filtering=True,id=c48dd5ca-ff1b-43d2-aa2b-28876a27b698,network=Network(aa578c0e-96d4-458e-ab66-c50d2934261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48dd5ca-ff') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc48dd5ca-ff, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dd634d2-1862-481e-9aa6-0295ae98ea0f) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: INFO os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:81:7e,bridge_name='br-int',has_traffic_filtering=True,id=c48dd5ca-ff1b-43d2-aa2b-28876a27b698,network=Network(aa578c0e-96d4-458e-ab66-c50d2934261b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc48dd5ca-ff')
Nov 10 12:14:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3b:14,bridge_name='br-int',has_traffic_filtering=True,id=ad634c53-9335-4a00-8976-d6f66f2462fc,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad634c53-93') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3b:14,bridge_name='br-int',has_traffic_filtering=True,id=ad634c53-9335-4a00-8976-d6f66f2462fc,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad634c53-93') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad634c53-93, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dfddd9b-488b-4ef6-9c36-9ab6337dffd9) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: INFO os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:3b:14,bridge_name='br-int',has_traffic_filtering=True,id=ad634c53-9335-4a00-8976-d6f66f2462fc,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapad634c53-93')
Nov 10 12:14:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:58:29,bridge_name='br-int',has_traffic_filtering=True,id=bd0d21a9-d10e-4de0-9348-74adff8baad3,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd0d21a9-d1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:58:29,bridge_name='br-int',has_traffic_filtering=True,id=bd0d21a9-d10e-4de0-9348-74adff8baad3,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd0d21a9-d1') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd0d21a9-d1, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb54ef40-5ea4-4ed2-99a6-9c2203d57b4e) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:14:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: INFO os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:58:29,bridge_name='br-int',has_traffic_filtering=True,id=bd0d21a9-d10e-4de0-9348-74adff8baad3,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbd0d21a9-d1')
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:43:52,bridge_name='br-int',has_traffic_filtering=True,id=d36952a8-d18b-4234-9829-3160f2e1882e,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36952a8-d1') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:43:52,bridge_name='br-int',has_traffic_filtering=True,id=d36952a8-d18b-4234-9829-3160f2e1882e,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36952a8-d1') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd36952a8-d1, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b5bd0fc-ac26-4d1f-b1d0-8749bbb4362a) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: INFO os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:43:52,bridge_name='br-int',has_traffic_filtering=True,id=d36952a8-d18b-4234-9829-3160f2e1882e,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd36952a8-d1')
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=65117c96-c353-458c-9df6-48237186ca2d,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65117c96-c3') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=65117c96-c353-458c-9df6-48237186ca2d,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65117c96-c3') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65117c96-c3, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b409d83-5906-4aaf-946f-962d607002d5) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: INFO os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b7:fd,bridge_name='br-int',has_traffic_filtering=True,id=65117c96-c353-458c-9df6-48237186ca2d,network=Network(1abbf358-8fce-401e-8fde-e9629f53efea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65117c96-c3')
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:8e:05,bridge_name='br-int',has_traffic_filtering=True,id=57ea1ebe-c6fa-4cee-9718-db0369133dc2,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ea1ebe-c6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:8e:05,bridge_name='br-int',has_traffic_filtering=True,id=57ea1ebe-c6fa-4cee-9718-db0369133dc2,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ea1ebe-c6') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57ea1ebe-c6, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b23d861-dc78-4b6a-afe8-0995b8aaf676) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: INFO os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:8e:05,bridge_name='br-int',has_traffic_filtering=True,id=57ea1ebe-c6fa-4cee-9718-db0369133dc2,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ea1ebe-c6')
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T12:11:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1455089407',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1455089407',id=34,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSbq3seReAqvciRmrP3XOaFPIKSLixwcIl95JtmaVVWwFO29nftArnvENz11dKv3i3DdWCQfYGJPlIz8s+f2bn5dFARAdDqJywtBzoL9JDo1otu+1owx88QGt/5qZK6VQ==',key_name='tempest-keypair-528987171',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44f81df6b2364ab4a0f6577d58aeb413',ramdisk_id='',reservation_id='r-toe1q8si',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2060735194',owner_user_name='tempest-TaggedBootDevicesTest_v242-2060735194-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:13:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='627e26b7a67f41dabc010d18327219d5',uuid=6d20b9d9-dfdd-4432-bb91-3bb6d6a905de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converting VIF {"id": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "address": "fa:16:3e:6d:f9:cc", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd32963-90", "ovs_interfaceid": "ccd32963-90a4-40ee-8d7e-e9896a20483c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=ccd32963-90a4-40ee-8d7e-e9896a20483c,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd32963-90') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=ccd32963-90a4-40ee-8d7e-e9896a20483c,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd32963-90') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccd32963-90, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87902e61-bee3-486f-9700-198481807a72) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:00 user nova-compute[74889]: INFO os_vif [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f9:cc,bridge_name='br-int',has_traffic_filtering=True,id=ccd32963-90a4-40ee-8d7e-e9896a20483c,network=Network(5a2ce4a7-f169-4e81-8e8e-7261bbfb869e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd32963-90')
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pmOZoJHL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:15:00 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[38da86fd-0800-42c4-9cc1-88980f1d27bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:15:00 user nova-compute[74889]: No targets found.
Nov 10 12:15:00 user nova-compute[74889]: iSNS:
Nov 10 12:15:00 user nova-compute[74889]: No targets found.
Nov 10 12:15:00 user nova-compute[74889]: STATIC:
Nov 10 12:15:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42
Nov 10 12:15:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:15:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:15:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0
Nov 10 12:15:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:15:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:15:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897
Nov 10 12:15:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:15:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:15:00 user nova-compute[74889]: FIRMWARE:
Nov 10 12:15:00 user nova-compute[74889]: No targets found.
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:15:00 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:15:00 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a53ccd-9b11-43b9-ad36-3b3eff1fcdd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcb6cf7-b60a-4243-bf50-ec5b37bc8e5a]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa39823c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: WARNING nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 for instance with vm_state active and task_state deleting.
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-unplugged-ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-ad634c53-9335-4a00-8976-d6f66f2462fc for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-ad634c53-9335-4a00-8976-d6f66f2462fc {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: WARNING nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-ad634c53-9335-4a00-8976-d6f66f2462fc for instance with vm_state active and task_state deleting.
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-unplugged-65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-65117c96-c353-458c-9df6-48237186ca2d for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: WARNING nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-65117c96-c353-458c-9df6-48237186ca2d for instance with vm_state active and task_state deleting.
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-unplugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: WARNING nova.compute.manager [req-7e0f00af-0067-41e7-ad95-cc8be1b1acdb req-ed4b8dab-b061-437f-aa2c-64cb8831e474 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-57ea1ebe-c6fa-4cee-9718-db0369133dc2 for instance with vm_state active and task_state deleting.
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53d27e6-92a7-478b-9b73-3b2896dcfc29]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66e5a81-7987-4e55-a6e4-1f671261678a]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[08eba8d9-5aaa-4ec0-be6b-2b15b014711b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b6e21e-aebb-49eb-8d97-f8e335ed6779]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddaa290-493b-4007-9b93-77eacc0b5f0f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f468bed2-728b-421d-9107-bf7d16a013e9]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42, portal: 172.16.0.220,3260]
Nov 10 12:15:00 user nova-compute[74889]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42, portal: 172.16.0.220,3260] successful.
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24ed6795-3545-4675-8826-e2cec2254d42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2327d597-d5ab-454b-aee6-b7105fec8c23]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] <== disconnect_volume: return (310ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VuyoehnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:15:00 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: WARNING nova.compute.manager [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-bd0d21a9-d10e-4de0-9348-74adff8baad3 for instance with vm_state active and task_state deleting.
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-unplugged-ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-unplugged-ccd32963-90a4-40ee-8d7e-e9896a20483c for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: WARNING nova.compute.manager [req-0511ac63-6807-402a-9d5c-0946d3b458b5 req-7d19c017-ea55-46b9-9396-febb126777ef service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-ccd32963-90a4-40ee-8d7e-e9896a20483c for instance with vm_state active and task_state deleting.
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44e1f64-57e2-4919-aac6-2ba595829679]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:15:00 user nova-compute[74889]: No targets found.
Nov 10 12:15:00 user nova-compute[74889]: iSNS:
Nov 10 12:15:00 user nova-compute[74889]: No targets found.
Nov 10 12:15:00 user nova-compute[74889]: STATIC:
Nov 10 12:15:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0
Nov 10 12:15:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:15:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:15:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897
Nov 10 12:15:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:15:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:15:00 user nova-compute[74889]: FIRMWARE:
Nov 10 12:15:00 user nova-compute[74889]: No targets found.
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:15:00 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:15:00 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac336cf7-533a-4501-a9c3-3174f67644c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdc1a3c-cdd8-424f-872f-262a25989272]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3983d1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0'): ({'sde'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Removing single pathed devices sde {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[16013516-4d3c-4445-9bf9-3715e1efbc0c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[482e79a9-01d5-407d-b693-e1ac994a663e]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Flushing IO for device /dev/sde {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93493c4-a364-4648-b454-227abfb66f88]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[408188fe-16c4-48cf-bb5d-b646ac7e1f2a]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-6278466e-7ed4-4ae3-a766-d9845b5d67df req-c3ba59dd-4f59-40f1-9d57-f670d73682e2 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-plugged-d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6278466e-7ed4-4ae3-a766-d9845b5d67df req-c3ba59dd-4f59-40f1-9d57-f670d73682e2 service nova] Acquiring lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6278466e-7ed4-4ae3-a766-d9845b5d67df req-c3ba59dd-4f59-40f1-9d57-f670d73682e2 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6278466e-7ed4-4ae3-a766-d9845b5d67df req-c3ba59dd-4f59-40f1-9d57-f670d73682e2 service nova] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-6278466e-7ed4-4ae3-a766-d9845b5d67df req-c3ba59dd-4f59-40f1-9d57-f670d73682e2 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] No waiting events found dispatching network-vif-plugged-d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:00 user nova-compute[74889]: WARNING nova.compute.manager [req-6278466e-7ed4-4ae3-a766-d9845b5d67df req-c3ba59dd-4f59-40f1-9d57-f670d73682e2 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received unexpected event network-vif-plugged-d36952a8-d18b-4234-9829-3160f2e1882e for instance with vm_state active and task_state deleting.
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0bcb73-7cc8-4234-b70d-03a2097b41bf]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[21493198-604b-442d-b89d-a43ba4c10775]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0, portal: 172.16.0.220,3260]
Nov 10 12:15:00 user nova-compute[74889]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0, portal: 172.16.0.220,3260] successful.
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dd148c2-6f11-4e2e-8691-cd118f6faeb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7599a90d-7cad-41f8-8ec5-e5be097d60cc]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] <== disconnect_volume: return (291ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HAvpTFjO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:15:00 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7093e1f2-0d35-4a5a-9ca7-1f496a888015]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:15:00 user nova-compute[74889]: No targets found.
Nov 10 12:15:00 user nova-compute[74889]: iSNS:
Nov 10 12:15:00 user nova-compute[74889]: No targets found.
Nov 10 12:15:00 user nova-compute[74889]: STATIC:
Nov 10 12:15:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897
Nov 10 12:15:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:15:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:15:00 user nova-compute[74889]: FIRMWARE:
Nov 10 12:15:00 user nova-compute[74889]: No targets found.
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:15:00 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:15:00 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5573a7a-f276-4eeb-83a2-fd208a967a30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2599cb-957c-434b-8a4e-c5e70c0769ab]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 (non-flash)
Nov 10 12:15:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398224790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897'): ({'sdf'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Removing single pathed devices sdf {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c13c34-9f93-4d6b-abd8-bfc13c945244]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0fcc85-0db7-4b6e-a1e3-b016b76f3d79]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Flushing IO for device /dev/sdf {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4549efa9-407f-45df-985b-a0665086ad48]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:15:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac9176a-b0c4-49b0-a6d8-073de274c67d]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] SCSI volumes sdf have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e901d4-e978-4fa9-9d27-f883a17ed667]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1533863-d75d-4624-a146-dc28dd41a87e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897, portal: 172.16.0.220,3260]
Nov 10 12:15:01 user nova-compute[74889]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897, portal: 172.16.0.220,3260] successful.
Nov 10 12:15:01 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b75d1c65-0da8-460b-92cf-cac22f578897 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[389642f1-0b53-4fa2-ad8e-fc6dcf1d8acd]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] <== disconnect_volume: return (290ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:15:01 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Deleting instance files /opt/stack/data/nova/instances/6d20b9d9-dfdd-4432-bb91-3bb6d6a905de_del
Nov 10 12:15:01 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Deletion of /opt/stack/data/nova/instances/6d20b9d9-dfdd-4432-bb91-3bb6d6a905de_del complete
Nov 10 12:15:01 user nova-compute[74889]: INFO nova.compute.manager [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Took 3.22 seconds to destroy the instance on the hypervisor.
Nov 10 12:15:01 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:15:01 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:15:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-b1e4b356-f748-4107-9413-a4e40d585ec1 req-e28699d9-76d0-42aa-8298-eecdc3048fd6 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-deleted-ccd32963-90a4-40ee-8d7e-e9896a20483c {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:03 user nova-compute[74889]: INFO nova.compute.manager [req-b1e4b356-f748-4107-9413-a4e40d585ec1 req-e28699d9-76d0-42aa-8298-eecdc3048fd6 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Neutron deleted interface ccd32963-90a4-40ee-8d7e-e9896a20483c; detaching it from the instance and deleting it from the info cache
Nov 10 12:15:03 user nova-compute[74889]: DEBUG nova.network.neutron [req-b1e4b356-f748-4107-9413-a4e40d585ec1 req-e28699d9-76d0-42aa-8298-eecdc3048fd6 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [{"id": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "address": "fa:16:3e:8b:81:7e", "network": {"id": "aa578c0e-96d4-458e-ab66-c50d2934261b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-957844069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc48dd5ca-ff", "ovs_interfaceid": "c48dd5ca-ff1b-43d2-aa2b-28876a27b698", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ad634c53-9335-4a00-8976-d6f66f2462fc", "address": "fa:16:3e:a7:3b:14", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad634c53-93", "ovs_interfaceid": "ad634c53-9335-4a00-8976-d6f66f2462fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "address": "fa:16:3e:a0:58:29", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.161", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d21a9-d1", "ovs_interfaceid": "bd0d21a9-d10e-4de0-9348-74adff8baad3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d36952a8-d18b-4234-9829-3160f2e1882e", "address": "fa:16:3e:5b:43:52", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd36952a8-d1", "ovs_interfaceid": "d36952a8-d18b-4234-9829-3160f2e1882e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "65117c96-c353-458c-9df6-48237186ca2d", "address": "fa:16:3e:53:b7:fd", "network": {"id": "1abbf358-8fce-401e-8fde-e9629f53efea", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379564452", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65117c96-c3", "ovs_interfaceid": "65117c96-c353-458c-9df6-48237186ca2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "address": "fa:16:3e:55:8e:05", "network": {"id": "5a2ce4a7-f169-4e81-8e8e-7261bbfb869e", "bridge": "br-int", "label": "tempest-device-tagging-net2-248298342", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "44f81df6b2364ab4a0f6577d58aeb413", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ea1ebe-c6", "ovs_interfaceid": "57ea1ebe-c6fa-4cee-9718-db0369133dc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:15:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-b1e4b356-f748-4107-9413-a4e40d585ec1 req-e28699d9-76d0-42aa-8298-eecdc3048fd6 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Detach interface failed, port_id=ccd32963-90a4-40ee-8d7e-e9896a20483c, reason: Instance 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:15:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-41c72dbe-03d2-4301-9244-0824827fb9de req-cd3352e3-dcb5-468c-ae8f-009b3da52b9e service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-changed-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-41c72dbe-03d2-4301-9244-0824827fb9de req-cd3352e3-dcb5-468c-ae8f-009b3da52b9e service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Refreshing instance network info cache due to event network-changed-4c1e4117-f6a1-46d7-9864-d17dacfd1eea. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:15:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-41c72dbe-03d2-4301-9244-0824827fb9de req-cd3352e3-dcb5-468c-ae8f-009b3da52b9e service nova] Acquiring lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:15:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-41c72dbe-03d2-4301-9244-0824827fb9de req-cd3352e3-dcb5-468c-ae8f-009b3da52b9e service nova] Acquired lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:15:04 user nova-compute[74889]: DEBUG nova.network.neutron [req-41c72dbe-03d2-4301-9244-0824827fb9de req-cd3352e3-dcb5-468c-ae8f-009b3da52b9e service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Refreshing network info cache for port 4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:15:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG nova.network.neutron [req-41c72dbe-03d2-4301-9244-0824827fb9de req-cd3352e3-dcb5-468c-ae8f-009b3da52b9e service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updated VIF entry in instance network info cache for port 4c1e4117-f6a1-46d7-9864-d17dacfd1eea. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG nova.network.neutron [req-41c72dbe-03d2-4301-9244-0824827fb9de req-cd3352e3-dcb5-468c-ae8f-009b3da52b9e service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating instance_info_cache with network_info: [{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-41c72dbe-03d2-4301-9244-0824827fb9de req-cd3352e3-dcb5-468c-ae8f-009b3da52b9e service nova] Releasing lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:15:05 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Took 4.15 seconds to deallocate network for instance.
Nov 10 12:15:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-9c5311a5-1c94-4339-a624-cd98b7f721a5 req-fbdb7672-2f3a-4409-b383-e964f84ffd64 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-deleted-57ea1ebe-c6fa-4cee-9718-db0369133dc2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-9c5311a5-1c94-4339-a624-cd98b7f721a5 req-fbdb7672-2f3a-4409-b383-e964f84ffd64 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-deleted-d36952a8-d18b-4234-9829-3160f2e1882e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-9c5311a5-1c94-4339-a624-cd98b7f721a5 req-fbdb7672-2f3a-4409-b383-e964f84ffd64 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-deleted-65117c96-c353-458c-9df6-48237186ca2d {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-9c5311a5-1c94-4339-a624-cd98b7f721a5 req-fbdb7672-2f3a-4409-b383-e964f84ffd64 service nova] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Received event network-vif-deleted-c48dd5ca-ff1b-43d2-aa2b-28876a27b698 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "dd45343e-ffad-435a-83da-ad9c64fba838" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:05 user nova-compute[74889]: INFO nova.compute.manager [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Terminating instance
Nov 10 12:15:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:15:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:06 user nova-compute[74889]: INFO nova.compute.manager [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] instance snapshotting
Nov 10 12:15:06 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Beginning live snapshot process
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json -f qcow2 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json -f qcow2 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:06 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Instance destroyed successfully.
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lazy-loading 'resources' on Instance uuid dd45343e-ffad-435a-83da-ad9c64fba838 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874173005',display_name='tempest-AttachVolumeNegativeTest-server-874173005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874173005',id=36,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/3R8S9hWvc5dnECaekK2OppGBz8/dWPeHBlY3gYVcnTHA/3wNxDprLSuMSULzS+SPkmLjNZ2a86G+d7AZ9MYPH71PLoTMcs8ytsdXcFPN1piF+W/NVYS0Ehlf1BNuTrw==',key_name='tempest-keypair-1952883171',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:11:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80c6ad4f23d94494b3f42cdbc7fd4516',ramdisk_id='',reservation_id='r-637yl0h9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-238498304',owner_user_name='tempest-AttachVolumeNegativeTest-238498304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3485bf67f27e4b72868b0adc1225bfeb',uuid=dd45343e-ffad-435a-83da-ad9c64fba838,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converting VIF {"id": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "address": "fa:16:3e:34:79:6f", "network": {"id": "1a842b1b-363a-409d-afcd-a91cdb08ada6", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2122844012-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80c6ad4f23d94494b3f42cdbc7fd4516", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f832d39-3d", "ovs_interfaceid": "1f832d39-3dac-4a72-ae5c-9ba95cd55983", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:79:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f832d39-3dac-4a72-ae5c-9ba95cd55983,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f832d39-3d') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG os_vif [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:79:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f832d39-3dac-4a72-ae5c-9ba95cd55983,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f832d39-3d') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f832d39-3d, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=268472ad-17ea-4d28-998a-1194bb56e745) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:06 user nova-compute[74889]: INFO os_vif [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:79:6f,bridge_name='br-int',has_traffic_filtering=True,id=1f832d39-3dac-4a72-ae5c-9ba95cd55983,network=Network(1a842b1b-363a-409d-afcd-a91cdb08ada6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f832d39-3d')
Nov 10 12:15:06 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Deleting instance files /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838_del
Nov 10 12:15:06 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Deletion of /opt/stack/data/nova/instances/dd45343e-ffad-435a-83da-ad9c64fba838_del complete
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:06 user nova-compute[74889]: INFO nova.compute.manager [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received event network-vif-unplugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] Acquiring lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] Lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] Lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] No waiting events found dispatching network-vif-unplugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received event network-vif-unplugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received event network-vif-plugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] Acquiring lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] Lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] Lock "dd45343e-ffad-435a-83da-ad9c64fba838-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] No waiting events found dispatching network-vif-plugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:06 user nova-compute[74889]: WARNING nova.compute.manager [req-ead4be68-5c87-4c29-85ee-e8bfc59ac584 req-f6543e5f-e85d-4eca-a12c-9a4afac1d61f service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received unexpected event network-vif-plugged-1f832d39-3dac-4a72-ae5c-9ba95cd55983 for instance with vm_state active and task_state deleting.
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4z9l4ozk/56edd18b253f49ef82d349803b19bc5d.delta 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4z9l4ozk/56edd18b253f49ef82d349803b19bc5d.delta 1073741824" returned: 0 in 0.054s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:07 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 12:15:07 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:15:07 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:15:07 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:15:07 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Took 0.74 seconds to deallocate network for instance.
Nov 10 12:15:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 12:15:07 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:15:07 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:15:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:08 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Deleted allocations for instance dd45343e-ffad-435a-83da-ad9c64fba838
Nov 10 12:15:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7b200ca2-4f0d-4efc-bc37-c1872e83b66b tempest-AttachVolumeNegativeTest-238498304 tempest-AttachVolumeNegativeTest-238498304-project-member] Lock "dd45343e-ffad-435a-83da-ad9c64fba838" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.247s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 12:15:08 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 12:15:08 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:15:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4z9l4ozk/56edd18b253f49ef82d349803b19bc5d.delta /opt/stack/data/nova/instances/snapshots/tmp4z9l4ozk/56edd18b253f49ef82d349803b19bc5d {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:08 user nova-compute[74889]: INFO nova.compute.manager [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] [instance: 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de] Took 3.13 seconds to detach 3 volumes for instance.
Nov 10 12:15:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:08 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:15:08 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:15:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:08 user nova-compute[74889]: DEBUG nova.compute.manager [req-600ff44c-66df-4f34-88da-0df3e5ee3bbf req-8bbe41dc-bce7-42a7-88ba-dfabcbdd1db7 service nova] [instance: dd45343e-ffad-435a-83da-ad9c64fba838] Received event network-vif-deleted-1f832d39-3dac-4a72-ae5c-9ba95cd55983 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:08 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Deleted allocations for instance 6d20b9d9-dfdd-4432-bb91-3bb6d6a905de
Nov 10 12:15:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4z9l4ozk/56edd18b253f49ef82d349803b19bc5d.delta /opt/stack/data/nova/instances/snapshots/tmp4z9l4ozk/56edd18b253f49ef82d349803b19bc5d" returned: 0 in 0.661s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:09 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Snapshot extracted, beginning image upload
Nov 10 12:15:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9c1a176c-5e48-487c-81fd-9be7400febcb tempest-TaggedBootDevicesTest_v242-2060735194 tempest-TaggedBootDevicesTest_v242-2060735194-project-member] Lock "6d20b9d9-dfdd-4432-bb91-3bb6d6a905de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.172s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:11 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Snapshot image upload complete
Nov 10 12:15:11 user nova-compute[74889]: INFO nova.compute.manager [None req-c270755e-7b1e-419a-8578-c400905b5f8d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Took 5.70 seconds to snapshot the instance on the hypervisor.
Nov 10 12:15:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "7f361287-3a8c-4422-992d-709d48c7c663" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:15:22 user nova-compute[74889]: INFO nova.compute.claims [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Claim successful on node user
Nov 10 12:15:22 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:15:22 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:15:22 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:15:22 user nova-compute[74889]: DEBUG nova.policy [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c2a48cfc9e04a2dbd2ad51b70c8b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757eef88e9c04404a1ddedfa23b6031d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:15:22 user nova-compute[74889]: INFO nova.virt.block_device [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Booting with blank volume at /dev/vda
Nov 10 12:15:23 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Successfully created port: 3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:15:23 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Successfully updated port: 3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:15:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:15:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquired lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:15:23 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:15:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-9e5441da-0342-460f-b137-e107bdc4b150 req-9b778dcb-ce6e-4092-82a0-a4a797a090dd service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-changed-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-9e5441da-0342-460f-b137-e107bdc4b150 req-9b778dcb-ce6e-4092-82a0-a4a797a090dd service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Refreshing instance network info cache due to event network-changed-3b04c830-c64d-4813-9b99-a80a2f87cec6. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:15:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e5441da-0342-460f-b137-e107bdc4b150 req-9b778dcb-ce6e-4092-82a0-a4a797a090dd service nova] Acquiring lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:15:23 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:15:24 user nova-compute[74889]: DEBUG nova.network.neutron [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updating instance_info_cache with network_info: [{"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:15:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Releasing lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:15:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Instance network_info: |[{"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:15:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e5441da-0342-460f-b137-e107bdc4b150 req-9b778dcb-ce6e-4092-82a0-a4a797a090dd service nova] Acquired lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:15:24 user nova-compute[74889]: DEBUG nova.network.neutron [req-9e5441da-0342-460f-b137-e107bdc4b150 req-9b778dcb-ce6e-4092-82a0-a4a797a090dd service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Refreshing network info cache for port 3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:15:24 user nova-compute[74889]: DEBUG nova.network.neutron [req-9e5441da-0342-460f-b137-e107bdc4b150 req-9b778dcb-ce6e-4092-82a0-a4a797a090dd service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updated VIF entry in instance network info cache for port 3b04c830-c64d-4813-9b99-a80a2f87cec6. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:15:24 user nova-compute[74889]: DEBUG nova.network.neutron [req-9e5441da-0342-460f-b137-e107bdc4b150 req-9b778dcb-ce6e-4092-82a0-a4a797a090dd service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updating instance_info_cache with network_info: [{"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:15:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e5441da-0342-460f-b137-e107bdc4b150 req-9b778dcb-ce6e-4092-82a0-a4a797a090dd service nova] Releasing lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:15:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:15:28 user nova-compute[74889]: INFO nova.compute.claims [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Claim successful on node user
Nov 10 12:15:28 user nova-compute[74889]: DEBUG os_brick.utils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[690a0728-66fc-4d70-9320-ebf0b4c93414]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8089df0-6105-4942-90a2-fe1a3d076492]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2932874a-1073-4cf3-a281-05a70559ae85]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fbb789-e85c-4804-acd1-473e1bd0a537]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:15:28 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d534f9-0004-4564-b0a2-e0f7b4fe468d]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG os_brick.utils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updating existing volume attachment record: 534dcb54-3950-48e1-9d6d-e7bb473a448e {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG nova.network.neutron [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:15:28 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:15:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG nova.policy [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b53b32c4dd094fb4a4b0618dc619b21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e703b195816426d9054c28fa6cd15cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:15:28 user nova-compute[74889]: INFO nova.virt.block_device [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Booting with volume a903fda4-49d0-4f34-809e-8f9613e65b7c at /dev/vda
Nov 10 12:15:28 user nova-compute[74889]: DEBUG os_brick.utils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b931ef-4ba5-43b8-aae1-18afaca8d47e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7919a77-ea4f-4164-a2e9-a736f83fbdc2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3685fb9-2f7f-4271-a6b6-de1aa7ce1332]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a0532-0eab-48d2-b892-95aa54351137]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:15:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:15:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:15:29 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:15:29 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4733c534-d2c1-49d2-802a-8db467328b59]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:15:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:15:29 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:15:29 user nova-compute[74889]: DEBUG os_brick.utils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:15:29 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updating existing volume attachment record: 56d0a257-9ad3-4b09-a979-3b9a51f46809 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:15:29 user nova-compute[74889]: DEBUG nova.network.neutron [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Successfully created port: be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Successfully updated port: be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquired lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-17dc077b-85a8-42f0-8cd7-eaae931acafe req-5278dee6-5a4a-4aa3-bc91-e4442dd4dbe6 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received event network-changed-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-17dc077b-85a8-42f0-8cd7-eaae931acafe req-5278dee6-5a4a-4aa3-bc91-e4442dd4dbe6 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Refreshing instance network info cache due to event network-changed-be7a9750-0602-490c-855b-5f6015d79ebd. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-17dc077b-85a8-42f0-8cd7-eaae931acafe req-5278dee6-5a4a-4aa3-bc91-e4442dd4dbe6 service nova] Acquiring lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updating instance_info_cache with network_info: [{"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Releasing lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Instance network_info: |[{"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-17dc077b-85a8-42f0-8cd7-eaae931acafe req-5278dee6-5a4a-4aa3-bc91-e4442dd4dbe6 service nova] Acquired lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:15:30 user nova-compute[74889]: DEBUG nova.network.neutron [req-17dc077b-85a8-42f0-8cd7-eaae931acafe req-5278dee6-5a4a-4aa3-bc91-e4442dd4dbe6 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Refreshing network info cache for port be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:15:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-17dc077b-85a8-42f0-8cd7-eaae931acafe req-5278dee6-5a4a-4aa3-bc91-e4442dd4dbe6 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updated VIF entry in instance network info cache for port be7a9750-0602-490c-855b-5f6015d79ebd. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:15:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-17dc077b-85a8-42f0-8cd7-eaae931acafe req-5278dee6-5a4a-4aa3-bc91-e4442dd4dbe6 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updating instance_info_cache with network_info: [{"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:15:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-17dc077b-85a8-42f0-8cd7-eaae931acafe req-5278dee6-5a4a-4aa3-bc91-e4442dd4dbe6 service nova] Releasing lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:15:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:15:52 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Creating image(s)
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Ensure instance console log exists: /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Start _get_guest_xml network_info=[{"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vEZCKAdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7f361287-3a8c-4422-992d-709d48c7c663', 'attached_at': '', 'detached_at': '', 'volume_id': '5ce2b95f-67fb-47fe-a193-87bb6e114f05', 'serial': '5ce2b95f-67fb-47fe-a193-87bb6e114f05'}, 'disk_bus': 'virtio', 'attachment_id': '534dcb54-3950-48e1-9d6d-e7bb473a448e', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:15:52 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:15:52 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:15:52 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vEZCKAdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:15:53 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:15:53 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:15:53 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2490375-84cb-4aa9-84f4-7ca810773a2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:15:53 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[127cc767-375a-4cb9-bcdf-240c45d33bbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05] added
Nov 10 12:15:53 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2152692e-bacc-40a0-98f3-20814fec6504]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1875a9c6-31e3-43bc-bf03-d9d98aee7fa3]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vEZCKAdD {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vEZCKAdD" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ee8e12-a908-4460-856b-93448d109ec1]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vEZCKAdD'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[92532558-6f63-4b23-b056-e516cc118d6c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa48aea3-2f21-415b-8ba1-05a5c5568b2c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 12:15:53 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 12:15:53 user nova-compute[74889]:  {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:15:53 user nova-compute[74889]: WARNING os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 12:15:53 user nova-compute[74889]: 
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3df0b2-656e-43d7-86c9-cc228e5046ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05, portal: 172.16.0.220,3260]
Nov 10 12:15:53 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05, portal: 172.16.0.220,3260] successful.
Nov 10 12:15:53 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd9d2b8-0311-4660-9435-ed44270c24f4]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f5f33f-5bb7-4027-93b3-a21d75ac136b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:15:53 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:15:53 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1cfb0d-3cc5-4549-bf59-9505fb79c742]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:15:53 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vEZCKAdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26365306339333532', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365306339333532', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:15:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-733470210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-733470210',id=39,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-hi0cjmad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:15:23Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=7f361287-3a8c-4422-992d-709d48c7c663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:40:f3,bridge_name='br-int',has_traffic_filtering=True,id=3b04c830-c64d-4813-9b99-a80a2f87cec6,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b04c830-c6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.objects.instance [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:15:54 user nova-compute[74889]:   <uuid>7f361287-3a8c-4422-992d-709d48c7c663</uuid>
Nov 10 12:15:54 user nova-compute[74889]:   <name>instance-00000027</name>
Nov 10 12:15:54 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:15:54 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:15:54 user nova-compute[74889]:   <metadata>
Nov 10 12:15:54 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:15:54 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:15:54 user nova-compute[74889]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-733470210</nova:name>
Nov 10 12:15:54 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:15:52</nova:creationTime>
Nov 10 12:15:54 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:15:54 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:15:54 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:15:54 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:15:54 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:15:54 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:15:54 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:15:54 user nova-compute[74889]:       <nova:owner>
Nov 10 12:15:54 user nova-compute[74889]:         <nova:user uuid="4c2a48cfc9e04a2dbd2ad51b70c8b114">tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member</nova:user>
Nov 10 12:15:54 user nova-compute[74889]:         <nova:project uuid="757eef88e9c04404a1ddedfa23b6031d">tempest-ServerBootFromVolumeStableRescueTest-1484079705</nova:project>
Nov 10 12:15:54 user nova-compute[74889]:       </nova:owner>
Nov 10 12:15:54 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:15:54 user nova-compute[74889]:       <nova:ports>
Nov 10 12:15:54 user nova-compute[74889]:         <nova:port uuid="3b04c830-c64d-4813-9b99-a80a2f87cec6">
Nov 10 12:15:54 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 12:15:54 user nova-compute[74889]:         </nova:port>
Nov 10 12:15:54 user nova-compute[74889]:       </nova:ports>
Nov 10 12:15:54 user nova-compute[74889]:     </nova:instance>
Nov 10 12:15:54 user nova-compute[74889]:   </metadata>
Nov 10 12:15:54 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:15:54 user nova-compute[74889]:     <system>
Nov 10 12:15:54 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:15:54 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:15:54 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:15:54 user nova-compute[74889]:       <entry name="serial">7f361287-3a8c-4422-992d-709d48c7c663</entry>
Nov 10 12:15:54 user nova-compute[74889]:       <entry name="uuid">7f361287-3a8c-4422-992d-709d48c7c663</entry>
Nov 10 12:15:54 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:15:54 user nova-compute[74889]:     </system>
Nov 10 12:15:54 user nova-compute[74889]:   </sysinfo>
Nov 10 12:15:54 user nova-compute[74889]:   <os>
Nov 10 12:15:54 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:15:54 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:15:54 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:15:54 user nova-compute[74889]:   </os>
Nov 10 12:15:54 user nova-compute[74889]:   <features>
Nov 10 12:15:54 user nova-compute[74889]:     <acpi/>
Nov 10 12:15:54 user nova-compute[74889]:     <apic/>
Nov 10 12:15:54 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:15:54 user nova-compute[74889]:   </features>
Nov 10 12:15:54 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:15:54 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:15:54 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:15:54 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:15:54 user nova-compute[74889]:   </clock>
Nov 10 12:15:54 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:15:54 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:15:54 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:15:54 user nova-compute[74889]:   </cpu>
Nov 10 12:15:54 user nova-compute[74889]:   <devices>
Nov 10 12:15:54 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:15:54 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:15:54 user nova-compute[74889]:       <source dev="/dev/sdb"/>
Nov 10 12:15:54 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:15:54 user nova-compute[74889]:       <serial>5ce2b95f-67fb-47fe-a193-87bb6e114f05</serial>
Nov 10 12:15:54 user nova-compute[74889]:     </disk>
Nov 10 12:15:54 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:15:54 user nova-compute[74889]:       <mac address="fa:16:3e:69:40:f3"/>
Nov 10 12:15:54 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:15:54 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:15:54 user nova-compute[74889]:       <target dev="tap3b04c830-c6"/>
Nov 10 12:15:54 user nova-compute[74889]:     </interface>
Nov 10 12:15:54 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:15:54 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/console.log" append="off"/>
Nov 10 12:15:54 user nova-compute[74889]:     </serial>
Nov 10 12:15:54 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:15:54 user nova-compute[74889]:     <video>
Nov 10 12:15:54 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:15:54 user nova-compute[74889]:     </video>
Nov 10 12:15:54 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:15:54 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:15:54 user nova-compute[74889]:     </rng>
Nov 10 12:15:54 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:15:54 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:15:54 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:15:54 user nova-compute[74889]:     </memballoon>
Nov 10 12:15:54 user nova-compute[74889]:   </devices>
Nov 10 12:15:54 user nova-compute[74889]: </domain>
Nov 10 12:15:54 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:15:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-733470210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-733470210',id=39,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-hi0cjmad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:15:23Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=7f361287-3a8c-4422-992d-709d48c7c663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:40:f3,bridge_name='br-int',has_traffic_filtering=True,id=3b04c830-c64d-4813-9b99-a80a2f87cec6,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b04c830-c6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG os_vif [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:40:f3,bridge_name='br-int',has_traffic_filtering=True,id=3b04c830-c64d-4813-9b99-a80a2f87cec6,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b04c830-c6') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Skipping network cache update for instance because it is Building. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Skipping network cache update for instance because it is Building. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b1aa9e6-1828-5123-9b67-bcd83e4fd4d8', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b04c830-c6, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b04c830-c6, col_values=(('qos', UUID('8e34901e-8e50-4e23-9f35-5007780b1947')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b04c830-c6, col_values=(('external_ids', {'iface-id': '3b04c830-c64d-4813-9b99-a80a2f87cec6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:40:f3', 'vm-uuid': '7f361287-3a8c-4422-992d-709d48c7c663'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:54 user nova-compute[74889]: INFO os_vif [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:40:f3,bridge_name='br-int',has_traffic_filtering=True,id=3b04c830-c64d-4813-9b99-a80a2f87cec6,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b04c830-c6')
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No VIF found with MAC fa:16:3e:69:40:f3, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid 662a3c8c-e0b0-4dea-b620-d11de1c5a92e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:15:54 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updating instance_info_cache with network_info: [{"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:15:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:15:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:15:55 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:15:55 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:15:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:15:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-7bffc1b2-7652-43ae-9799-ca168e3baee3 req-74ff217e-d64e-4f49-a1d6-32c018e30517 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7bffc1b2-7652-43ae-9799-ca168e3baee3 req-74ff217e-d64e-4f49-a1d6-32c018e30517 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7bffc1b2-7652-43ae-9799-ca168e3baee3 req-74ff217e-d64e-4f49-a1d6-32c018e30517 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7bffc1b2-7652-43ae-9799-ca168e3baee3 req-74ff217e-d64e-4f49-a1d6-32c018e30517 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-7bffc1b2-7652-43ae-9799-ca168e3baee3 req-74ff217e-d64e-4f49-a1d6-32c018e30517 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:56 user nova-compute[74889]: WARNING nova.compute.manager [req-7bffc1b2-7652-43ae-9799-ca168e3baee3 req-74ff217e-d64e-4f49-a1d6-32c018e30517 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state building and task_state spawning.
Nov 10 12:15:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:15:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-9d113920-e727-48f9-9e41-1d9bba9acb27 req-8c98cd43-f489-40f3-bec3-6485c4051db4 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9d113920-e727-48f9-9e41-1d9bba9acb27 req-8c98cd43-f489-40f3-bec3-6485c4051db4 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9d113920-e727-48f9-9e41-1d9bba9acb27 req-8c98cd43-f489-40f3-bec3-6485c4051db4 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9d113920-e727-48f9-9e41-1d9bba9acb27 req-8c98cd43-f489-40f3-bec3-6485c4051db4 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-9d113920-e727-48f9-9e41-1d9bba9acb27 req-8c98cd43-f489-40f3-bec3-6485c4051db4 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:15:58 user nova-compute[74889]: WARNING nova.compute.manager [req-9d113920-e727-48f9-9e41-1d9bba9acb27 req-8c98cd43-f489-40f3-bec3-6485c4051db4 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state building and task_state spawning.
Nov 10 12:15:58 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Instance spawned successfully.
Nov 10 12:15:58 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:15:58 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8675MB free_disk=25.315662384033203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:15:58 user nova-compute[74889]: INFO nova.compute.manager [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:15:58 user nova-compute[74889]: INFO nova.compute.manager [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Took 36.51 seconds to build instance.
Nov 10 12:15:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c76fb7bc-8813-484b-996f-5c10582e371c tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "7f361287-3a8c-4422-992d-709d48c7c663" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.624s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:15:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:15:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:15:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:15:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:15:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:02 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:16:03 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Creating image(s)
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Ensure instance console log exists: /opt/stack/data/nova/instances/215c5f9c-13dd-45ba-a4d2-30fddb6e0fff/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Start _get_guest_xml network_info=[{"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjutlEDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '215c5f9c-13dd-45ba-a4d2-30fddb6e0fff', 'attached_at': '', 'detached_at': '', 'volume_id': 'a903fda4-49d0-4f34-809e-8f9613e65b7c', 'serial': 'a903fda4-49d0-4f34-809e-8f9613e65b7c'}, 'disk_bus': 'virtio', 'attachment_id': '56d0a257-9ad3-4b09-a979-3b9a51f46809', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:16:03 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:16:03 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjutlEDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:16:03 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:16:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:16:03 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:16:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:16:03 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:16:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6752dd-d742-4cdf-820a-c47902034eb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:16:04 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[690f40f1-3971-4fc2-b2b4-7eb8fd213075]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c] added
Nov 10 12:16:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a546d320-711e-4604-9756-622623f6948e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d6ce9d-b9aa-4e78-9439-4e0f236e025f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjutlEDq {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjutlEDq" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97a9b13-a268-4cda-b055-425eae58da22]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjutlEDq'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b2fb40-c650-4d67-821e-ac840f3e276c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed71906-9048-48fb-9e62-9b508f66c677]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:16:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:16:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6919a435-52b1-49d2-9b12-ad8e4eb855fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260]
Nov 10 12:16:04 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260] successful.
Nov 10 12:16:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8607f4-f391-4a3c-b011-3ba79060ab32]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53b70a2-5635-44ef-acc0-3816faf61140]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:16:04 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:16:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:16:04 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:16:04 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbda76c-a84a-4060-bd9c-15348e42fc6d]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjutlEDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:16:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23937383734363936', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937383734363936', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1835683287',display_name='tempest-TestVolumeBootPattern-server-1835683287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1835683287',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5sI8i7f1ePG/W7UaO+8+gsVMkmIp2O9S2Zp/OA7rnj2vqp7KJJD0civJv0L7iUGqDlP4rsFJ2tgFLkt5XPKycZVXji+0bjZyXuGwJUvRKhSllkY2ECb15wAksxQrkIeg==',key_name='tempest-TestVolumeBootPattern-597466952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-zkivbekj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:15:29Z,user_data=None,user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=215c5f9c-13dd-45ba-a4d2-30fddb6e0fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:02:38,bridge_name='br-int',has_traffic_filtering=True,id=be7a9750-0602-490c-855b-5f6015d79ebd,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7a9750-06') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lazy-loading 'pci_devices' on Instance uuid 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:16:05 user nova-compute[74889]:   <uuid>215c5f9c-13dd-45ba-a4d2-30fddb6e0fff</uuid>
Nov 10 12:16:05 user nova-compute[74889]:   <name>instance-00000028</name>
Nov 10 12:16:05 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:16:05 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:16:05 user nova-compute[74889]:   <metadata>
Nov 10 12:16:05 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:16:05 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:16:05 user nova-compute[74889]:       <nova:name>tempest-TestVolumeBootPattern-server-1835683287</nova:name>
Nov 10 12:16:05 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:16:03</nova:creationTime>
Nov 10 12:16:05 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:16:05 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:16:05 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:16:05 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:16:05 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:16:05 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:16:05 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:16:05 user nova-compute[74889]:       <nova:owner>
Nov 10 12:16:05 user nova-compute[74889]:         <nova:user uuid="b53b32c4dd094fb4a4b0618dc619b21f">tempest-TestVolumeBootPattern-1577456798-project-member</nova:user>
Nov 10 12:16:05 user nova-compute[74889]:         <nova:project uuid="1e703b195816426d9054c28fa6cd15cc">tempest-TestVolumeBootPattern-1577456798</nova:project>
Nov 10 12:16:05 user nova-compute[74889]:       </nova:owner>
Nov 10 12:16:05 user nova-compute[74889]:       <nova:ports>
Nov 10 12:16:05 user nova-compute[74889]:         <nova:port uuid="be7a9750-0602-490c-855b-5f6015d79ebd">
Nov 10 12:16:05 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 12:16:05 user nova-compute[74889]:         </nova:port>
Nov 10 12:16:05 user nova-compute[74889]:       </nova:ports>
Nov 10 12:16:05 user nova-compute[74889]:     </nova:instance>
Nov 10 12:16:05 user nova-compute[74889]:   </metadata>
Nov 10 12:16:05 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:16:05 user nova-compute[74889]:     <system>
Nov 10 12:16:05 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:16:05 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:16:05 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:16:05 user nova-compute[74889]:       <entry name="serial">215c5f9c-13dd-45ba-a4d2-30fddb6e0fff</entry>
Nov 10 12:16:05 user nova-compute[74889]:       <entry name="uuid">215c5f9c-13dd-45ba-a4d2-30fddb6e0fff</entry>
Nov 10 12:16:05 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:16:05 user nova-compute[74889]:     </system>
Nov 10 12:16:05 user nova-compute[74889]:   </sysinfo>
Nov 10 12:16:05 user nova-compute[74889]:   <os>
Nov 10 12:16:05 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:16:05 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:16:05 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:16:05 user nova-compute[74889]:   </os>
Nov 10 12:16:05 user nova-compute[74889]:   <features>
Nov 10 12:16:05 user nova-compute[74889]:     <acpi/>
Nov 10 12:16:05 user nova-compute[74889]:     <apic/>
Nov 10 12:16:05 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:16:05 user nova-compute[74889]:   </features>
Nov 10 12:16:05 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:16:05 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:16:05 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:16:05 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:16:05 user nova-compute[74889]:   </clock>
Nov 10 12:16:05 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:16:05 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:16:05 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:16:05 user nova-compute[74889]:   </cpu>
Nov 10 12:16:05 user nova-compute[74889]:   <devices>
Nov 10 12:16:05 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:16:05 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:16:05 user nova-compute[74889]:       <source dev="/dev/sdc"/>
Nov 10 12:16:05 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:16:05 user nova-compute[74889]:       <serial>a903fda4-49d0-4f34-809e-8f9613e65b7c</serial>
Nov 10 12:16:05 user nova-compute[74889]:     </disk>
Nov 10 12:16:05 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:16:05 user nova-compute[74889]:       <mac address="fa:16:3e:16:02:38"/>
Nov 10 12:16:05 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:16:05 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:16:05 user nova-compute[74889]:       <target dev="tapbe7a9750-06"/>
Nov 10 12:16:05 user nova-compute[74889]:     </interface>
Nov 10 12:16:05 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:16:05 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/215c5f9c-13dd-45ba-a4d2-30fddb6e0fff/console.log" append="off"/>
Nov 10 12:16:05 user nova-compute[74889]:     </serial>
Nov 10 12:16:05 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:16:05 user nova-compute[74889]:     <video>
Nov 10 12:16:05 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:16:05 user nova-compute[74889]:     </video>
Nov 10 12:16:05 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:16:05 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:16:05 user nova-compute[74889]:     </rng>
Nov 10 12:16:05 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:16:05 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:16:05 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:16:05 user nova-compute[74889]:     </memballoon>
Nov 10 12:16:05 user nova-compute[74889]:   </devices>
Nov 10 12:16:05 user nova-compute[74889]: </domain>
Nov 10 12:16:05 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1835683287',display_name='tempest-TestVolumeBootPattern-server-1835683287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1835683287',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5sI8i7f1ePG/W7UaO+8+gsVMkmIp2O9S2Zp/OA7rnj2vqp7KJJD0civJv0L7iUGqDlP4rsFJ2tgFLkt5XPKycZVXji+0bjZyXuGwJUvRKhSllkY2ECb15wAksxQrkIeg==',key_name='tempest-TestVolumeBootPattern-597466952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-zkivbekj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:15:29Z,user_data=None,user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=215c5f9c-13dd-45ba-a4d2-30fddb6e0fff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:02:38,bridge_name='br-int',has_traffic_filtering=True,id=be7a9750-0602-490c-855b-5f6015d79ebd,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7a9750-06') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG os_vif [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:02:38,bridge_name='br-int',has_traffic_filtering=True,id=be7a9750-0602-490c-855b-5f6015d79ebd,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7a9750-06') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6d06182-99d8-560a-851a-5bdadae17169', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe7a9750-06, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe7a9750-06, col_values=(('qos', UUID('64d60116-c9c6-4778-b51b-14e574aad745')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe7a9750-06, col_values=(('external_ids', {'iface-id': 'be7a9750-0602-490c-855b-5f6015d79ebd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:02:38', 'vm-uuid': '215c5f9c-13dd-45ba-a4d2-30fddb6e0fff'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:05 user nova-compute[74889]: INFO os_vif [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:02:38,bridge_name='br-int',has_traffic_filtering=True,id=be7a9750-0602-490c-855b-5f6015d79ebd,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7a9750-06')
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:16:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] No VIF found with MAC fa:16:3e:16:02:38, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:16:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-ffc631e5-4723-4977-974e-446bfb7b475b req-6cee6d7a-e7b7-49e5-83bb-2ca386ff7025 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received event network-vif-plugged-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:16:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ffc631e5-4723-4977-974e-446bfb7b475b req-6cee6d7a-e7b7-49e5-83bb-2ca386ff7025 service nova] Acquiring lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ffc631e5-4723-4977-974e-446bfb7b475b req-6cee6d7a-e7b7-49e5-83bb-2ca386ff7025 service nova] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ffc631e5-4723-4977-974e-446bfb7b475b req-6cee6d7a-e7b7-49e5-83bb-2ca386ff7025 service nova] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-ffc631e5-4723-4977-974e-446bfb7b475b req-6cee6d7a-e7b7-49e5-83bb-2ca386ff7025 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] No waiting events found dispatching network-vif-plugged-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:16:07 user nova-compute[74889]: WARNING nova.compute.manager [req-ffc631e5-4723-4977-974e-446bfb7b475b req-6cee6d7a-e7b7-49e5-83bb-2ca386ff7025 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received unexpected event network-vif-plugged-be7a9750-0602-490c-855b-5f6015d79ebd for instance with vm_state building and task_state spawning.
Nov 10 12:16:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:16:08 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:16:09 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Instance spawned successfully.
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.compute.manager [req-1759405a-df90-4511-8bda-b0854ca8ec2c req-f4194670-7f93-4946-b9ff-f0954058e931 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received event network-vif-plugged-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1759405a-df90-4511-8bda-b0854ca8ec2c req-f4194670-7f93-4946-b9ff-f0954058e931 service nova] Acquiring lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1759405a-df90-4511-8bda-b0854ca8ec2c req-f4194670-7f93-4946-b9ff-f0954058e931 service nova] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1759405a-df90-4511-8bda-b0854ca8ec2c req-f4194670-7f93-4946-b9ff-f0954058e931 service nova] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.compute.manager [req-1759405a-df90-4511-8bda-b0854ca8ec2c req-f4194670-7f93-4946-b9ff-f0954058e931 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] No waiting events found dispatching network-vif-plugged-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:16:09 user nova-compute[74889]: WARNING nova.compute.manager [req-1759405a-df90-4511-8bda-b0854ca8ec2c req-f4194670-7f93-4946-b9ff-f0954058e931 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received unexpected event network-vif-plugged-be7a9750-0602-490c-855b-5f6015d79ebd for instance with vm_state building and task_state spawning.
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:09 user nova-compute[74889]: INFO nova.compute.manager [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 10 12:16:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:16:09 user nova-compute[74889]: INFO nova.compute.manager [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Took 41.06 seconds to build instance.
Nov 10 12:16:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9443a893-a681-4dc6-8656-791a61ec4f73 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.157s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "de32b888-15ed-42eb-9029-1cb3dc471253" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:16:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:16:45 user nova-compute[74889]: INFO nova.compute.claims [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Claim successful on node user
Nov 10 12:16:45 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:16:45 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.297s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:16:46 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:16:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG nova.policy [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db6e671b33f14840b2a79a3affbbaaa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c4b9efdfb14eadb63b747cc3c6003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:16:46 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Creating image(s)
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Successfully created port: 9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk 1073741824" returned: 0 in 0.114s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3824b4fa-25e2-436d-87d8-762353765644" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.203s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:16:47 user nova-compute[74889]: INFO nova.compute.claims [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Claim successful on node user
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Cannot resize image /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Ensure instance console log exists: /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Successfully updated port: 9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquired lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.network.neutron [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:16:47 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-6940f29e-9ebb-46c1-b99e-fc867ddc3654 req-f4feebed-85c5-43c4-ab89-b0c68f092596 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-changed-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-6940f29e-9ebb-46c1-b99e-fc867ddc3654 req-f4feebed-85c5-43c4-ab89-b0c68f092596 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Refreshing instance network info cache due to event network-changed-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6940f29e-9ebb-46c1-b99e-fc867ddc3654 req-f4feebed-85c5-43c4-ab89-b0c68f092596 service nova] Acquiring lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.policy [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db6e671b33f14840b2a79a3affbbaaa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c4b9efdfb14eadb63b747cc3c6003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:16:47 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Creating image(s)
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updating instance_info_cache with network_info: [{"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Releasing lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Instance network_info: |[{"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6940f29e-9ebb-46c1-b99e-fc867ddc3654 req-f4feebed-85c5-43c4-ab89-b0c68f092596 service nova] Acquired lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-6940f29e-9ebb-46c1-b99e-fc867ddc3654 req-f4feebed-85c5-43c4-ab89-b0c68f092596 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Refreshing network info cache for port 9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Start _get_guest_xml network_info=[{"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:16:47 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:16:47 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387647068',display_name='tempest-ServerRescueNegativeTestJSON-server-1387647068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1387647068',id=41,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-b2yoos3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:16:46Z,user_data=None,user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=de32b888-15ed-42eb-9029-1cb3dc471253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=9d2cfd53-72da-4fb7-bc5d-c139019fa9e7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d2cfd53-72') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'pci_devices' on Instance uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.227s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:16:47 user nova-compute[74889]:   <uuid>de32b888-15ed-42eb-9029-1cb3dc471253</uuid>
Nov 10 12:16:47 user nova-compute[74889]:   <name>instance-00000029</name>
Nov 10 12:16:47 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:16:47 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:16:47 user nova-compute[74889]:   <metadata>
Nov 10 12:16:47 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:16:47 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:16:47 user nova-compute[74889]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1387647068</nova:name>
Nov 10 12:16:47 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:16:47</nova:creationTime>
Nov 10 12:16:47 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:16:47 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:16:47 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:16:47 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:16:47 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:16:47 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:16:47 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:16:47 user nova-compute[74889]:       <nova:owner>
Nov 10 12:16:47 user nova-compute[74889]:         <nova:user uuid="db6e671b33f14840b2a79a3affbbaaa8">tempest-ServerRescueNegativeTestJSON-524488673-project-member</nova:user>
Nov 10 12:16:47 user nova-compute[74889]:         <nova:project uuid="62c4b9efdfb14eadb63b747cc3c6003f">tempest-ServerRescueNegativeTestJSON-524488673</nova:project>
Nov 10 12:16:47 user nova-compute[74889]:       </nova:owner>
Nov 10 12:16:47 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:16:47 user nova-compute[74889]:       <nova:ports>
Nov 10 12:16:47 user nova-compute[74889]:         <nova:port uuid="9d2cfd53-72da-4fb7-bc5d-c139019fa9e7">
Nov 10 12:16:47 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 12:16:47 user nova-compute[74889]:         </nova:port>
Nov 10 12:16:47 user nova-compute[74889]:       </nova:ports>
Nov 10 12:16:47 user nova-compute[74889]:     </nova:instance>
Nov 10 12:16:47 user nova-compute[74889]:   </metadata>
Nov 10 12:16:47 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:16:47 user nova-compute[74889]:     <system>
Nov 10 12:16:47 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:16:47 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:16:47 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:16:47 user nova-compute[74889]:       <entry name="serial">de32b888-15ed-42eb-9029-1cb3dc471253</entry>
Nov 10 12:16:47 user nova-compute[74889]:       <entry name="uuid">de32b888-15ed-42eb-9029-1cb3dc471253</entry>
Nov 10 12:16:47 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:16:47 user nova-compute[74889]:     </system>
Nov 10 12:16:47 user nova-compute[74889]:   </sysinfo>
Nov 10 12:16:47 user nova-compute[74889]:   <os>
Nov 10 12:16:47 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:16:47 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:16:47 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:16:47 user nova-compute[74889]:   </os>
Nov 10 12:16:47 user nova-compute[74889]:   <features>
Nov 10 12:16:47 user nova-compute[74889]:     <acpi/>
Nov 10 12:16:47 user nova-compute[74889]:     <apic/>
Nov 10 12:16:47 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:16:47 user nova-compute[74889]:   </features>
Nov 10 12:16:47 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:16:47 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:16:47 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:16:47 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:16:47 user nova-compute[74889]:   </clock>
Nov 10 12:16:47 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:16:47 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:16:47 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:16:47 user nova-compute[74889]:   </cpu>
Nov 10 12:16:47 user nova-compute[74889]:   <devices>
Nov 10 12:16:47 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:16:47 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:16:47 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk"/>
Nov 10 12:16:47 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:16:47 user nova-compute[74889]:     </disk>
Nov 10 12:16:47 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:16:47 user nova-compute[74889]:       <mac address="fa:16:3e:a1:a6:69"/>
Nov 10 12:16:47 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:16:47 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:16:47 user nova-compute[74889]:       <target dev="tap9d2cfd53-72"/>
Nov 10 12:16:47 user nova-compute[74889]:     </interface>
Nov 10 12:16:47 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:16:47 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/console.log" append="off"/>
Nov 10 12:16:47 user nova-compute[74889]:     </serial>
Nov 10 12:16:47 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:16:47 user nova-compute[74889]:     <video>
Nov 10 12:16:47 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:16:47 user nova-compute[74889]:     </video>
Nov 10 12:16:47 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:16:47 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:16:47 user nova-compute[74889]:     </rng>
Nov 10 12:16:47 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:16:47 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:16:47 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:16:47 user nova-compute[74889]:     </memballoon>
Nov 10 12:16:47 user nova-compute[74889]:   </devices>
Nov 10 12:16:47 user nova-compute[74889]: </domain>
Nov 10 12:16:47 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387647068',display_name='tempest-ServerRescueNegativeTestJSON-server-1387647068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1387647068',id=41,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-b2yoos3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:16:46Z,user_data=None,user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=de32b888-15ed-42eb-9029-1cb3dc471253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=9d2cfd53-72da-4fb7-bc5d-c139019fa9e7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d2cfd53-72') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG os_vif [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=9d2cfd53-72da-4fb7-bc5d-c139019fa9e7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d2cfd53-72') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '211a3886-02cb-55c8-8bcc-c51f5653fefb', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d2cfd53-72, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d2cfd53-72, col_values=(('qos', UUID('f2ae2b86-414b-4810-b089-7e916d33eb1e')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d2cfd53-72, col_values=(('external_ids', {'iface-id': '9d2cfd53-72da-4fb7-bc5d-c139019fa9e7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:a6:69', 'vm-uuid': 'de32b888-15ed-42eb-9029-1cb3dc471253'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:16:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:47 user nova-compute[74889]: INFO os_vif [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=9d2cfd53-72da-4fb7-bc5d-c139019fa9e7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d2cfd53-72')
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No VIF found with MAC fa:16:3e:a1:a6:69, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.216s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk 1073741824" returned: 0 in 0.062s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.network.neutron [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Successfully created port: 66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.network.neutron [req-6940f29e-9ebb-46c1-b99e-fc867ddc3654 req-f4feebed-85c5-43c4-ab89-b0c68f092596 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updated VIF entry in instance network info cache for port 9d2cfd53-72da-4fb7-bc5d-c139019fa9e7. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.network.neutron [req-6940f29e-9ebb-46c1-b99e-fc867ddc3654 req-f4feebed-85c5-43c4-ab89-b0c68f092596 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updating instance_info_cache with network_info: [{"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6940f29e-9ebb-46c1-b99e-fc867ddc3654 req-f4feebed-85c5-43c4-ab89-b0c68f092596 service nova] Releasing lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Cannot resize image /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Ensure instance console log exists: /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.network.neutron [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Successfully updated port: 66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquired lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.network.neutron [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-988b068e-4e1b-4df9-ac10-561744e5a9fc req-b622f61d-7894-4db4-bf50-2963752ca3f5 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-changed-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-988b068e-4e1b-4df9-ac10-561744e5a9fc req-b622f61d-7894-4db4-bf50-2963752ca3f5 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Refreshing instance network info cache due to event network-changed-66f57458-b8da-4024-bff4-6985155568a7. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-988b068e-4e1b-4df9-ac10-561744e5a9fc req-b622f61d-7894-4db4-bf50-2963752ca3f5 service nova] Acquiring lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:16:48 user nova-compute[74889]: DEBUG nova.network.neutron [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.network.neutron [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updating instance_info_cache with network_info: [{"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Releasing lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Instance network_info: |[{"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-988b068e-4e1b-4df9-ac10-561744e5a9fc req-b622f61d-7894-4db4-bf50-2963752ca3f5 service nova] Acquired lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.network.neutron [req-988b068e-4e1b-4df9-ac10-561744e5a9fc req-b622f61d-7894-4db4-bf50-2963752ca3f5 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Refreshing network info cache for port 66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Start _get_guest_xml network_info=[{"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:16:49 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:16:49 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-128065686',display_name='tempest-ServerRescueNegativeTestJSON-server-128065686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-128065686',id=42,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-vw8fbr6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:16:48Z,user_data=None,user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=3824b4fa-25e2-436d-87d8-762353765644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:61:9b,bridge_name='br-int',has_traffic_filtering=True,id=66f57458-b8da-4024-bff4-6985155568a7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f57458-b8') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.objects.instance [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'pci_devices' on Instance uuid 3824b4fa-25e2-436d-87d8-762353765644 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:16:49 user nova-compute[74889]:   <uuid>3824b4fa-25e2-436d-87d8-762353765644</uuid>
Nov 10 12:16:49 user nova-compute[74889]:   <name>instance-0000002a</name>
Nov 10 12:16:49 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:16:49 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:16:49 user nova-compute[74889]:   <metadata>
Nov 10 12:16:49 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:16:49 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:16:49 user nova-compute[74889]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-128065686</nova:name>
Nov 10 12:16:49 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:16:49</nova:creationTime>
Nov 10 12:16:49 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:16:49 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:16:49 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:16:49 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:16:49 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:16:49 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:16:49 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:16:49 user nova-compute[74889]:       <nova:owner>
Nov 10 12:16:49 user nova-compute[74889]:         <nova:user uuid="db6e671b33f14840b2a79a3affbbaaa8">tempest-ServerRescueNegativeTestJSON-524488673-project-member</nova:user>
Nov 10 12:16:49 user nova-compute[74889]:         <nova:project uuid="62c4b9efdfb14eadb63b747cc3c6003f">tempest-ServerRescueNegativeTestJSON-524488673</nova:project>
Nov 10 12:16:49 user nova-compute[74889]:       </nova:owner>
Nov 10 12:16:49 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:16:49 user nova-compute[74889]:       <nova:ports>
Nov 10 12:16:49 user nova-compute[74889]:         <nova:port uuid="66f57458-b8da-4024-bff4-6985155568a7">
Nov 10 12:16:49 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 12:16:49 user nova-compute[74889]:         </nova:port>
Nov 10 12:16:49 user nova-compute[74889]:       </nova:ports>
Nov 10 12:16:49 user nova-compute[74889]:     </nova:instance>
Nov 10 12:16:49 user nova-compute[74889]:   </metadata>
Nov 10 12:16:49 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:16:49 user nova-compute[74889]:     <system>
Nov 10 12:16:49 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:16:49 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:16:49 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:16:49 user nova-compute[74889]:       <entry name="serial">3824b4fa-25e2-436d-87d8-762353765644</entry>
Nov 10 12:16:49 user nova-compute[74889]:       <entry name="uuid">3824b4fa-25e2-436d-87d8-762353765644</entry>
Nov 10 12:16:49 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:16:49 user nova-compute[74889]:     </system>
Nov 10 12:16:49 user nova-compute[74889]:   </sysinfo>
Nov 10 12:16:49 user nova-compute[74889]:   <os>
Nov 10 12:16:49 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:16:49 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:16:49 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:16:49 user nova-compute[74889]:   </os>
Nov 10 12:16:49 user nova-compute[74889]:   <features>
Nov 10 12:16:49 user nova-compute[74889]:     <acpi/>
Nov 10 12:16:49 user nova-compute[74889]:     <apic/>
Nov 10 12:16:49 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:16:49 user nova-compute[74889]:   </features>
Nov 10 12:16:49 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:16:49 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:16:49 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:16:49 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:16:49 user nova-compute[74889]:   </clock>
Nov 10 12:16:49 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:16:49 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:16:49 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:16:49 user nova-compute[74889]:   </cpu>
Nov 10 12:16:49 user nova-compute[74889]:   <devices>
Nov 10 12:16:49 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:16:49 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:16:49 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk"/>
Nov 10 12:16:49 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:16:49 user nova-compute[74889]:     </disk>
Nov 10 12:16:49 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:16:49 user nova-compute[74889]:       <mac address="fa:16:3e:03:61:9b"/>
Nov 10 12:16:49 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:16:49 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:16:49 user nova-compute[74889]:       <target dev="tap66f57458-b8"/>
Nov 10 12:16:49 user nova-compute[74889]:     </interface>
Nov 10 12:16:49 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:16:49 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/console.log" append="off"/>
Nov 10 12:16:49 user nova-compute[74889]:     </serial>
Nov 10 12:16:49 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:16:49 user nova-compute[74889]:     <video>
Nov 10 12:16:49 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:16:49 user nova-compute[74889]:     </video>
Nov 10 12:16:49 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:16:49 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:16:49 user nova-compute[74889]:     </rng>
Nov 10 12:16:49 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:16:49 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:16:49 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:16:49 user nova-compute[74889]:     </memballoon>
Nov 10 12:16:49 user nova-compute[74889]:   </devices>
Nov 10 12:16:49 user nova-compute[74889]: </domain>
Nov 10 12:16:49 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-128065686',display_name='tempest-ServerRescueNegativeTestJSON-server-128065686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-128065686',id=42,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-vw8fbr6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:16:48Z,user_data=None,user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=3824b4fa-25e2-436d-87d8-762353765644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:61:9b,bridge_name='br-int',has_traffic_filtering=True,id=66f57458-b8da-4024-bff4-6985155568a7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f57458-b8') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG os_vif [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:61:9b,bridge_name='br-int',has_traffic_filtering=True,id=66f57458-b8da-4024-bff4-6985155568a7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f57458-b8') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b325d308-ff57-5fab-8341-fc6a910c2665', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66f57458-b8, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66f57458-b8, col_values=(('qos', UUID('1e07b617-0efe-4248-ae74-0b6d785a454f')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66f57458-b8, col_values=(('external_ids', {'iface-id': '66f57458-b8da-4024-bff4-6985155568a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:61:9b', 'vm-uuid': '3824b4fa-25e2-436d-87d8-762353765644'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:49 user nova-compute[74889]: INFO os_vif [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:61:9b,bridge_name='br-int',has_traffic_filtering=True,id=66f57458-b8da-4024-bff4-6985155568a7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f57458-b8')
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No VIF found with MAC fa:16:3e:03:61:9b, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.network.neutron [req-988b068e-4e1b-4df9-ac10-561744e5a9fc req-b622f61d-7894-4db4-bf50-2963752ca3f5 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updated VIF entry in instance network info cache for port 66f57458-b8da-4024-bff4-6985155568a7. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG nova.network.neutron [req-988b068e-4e1b-4df9-ac10-561744e5a9fc req-b622f61d-7894-4db4-bf50-2963752ca3f5 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updating instance_info_cache with network_info: [{"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-988b068e-4e1b-4df9-ac10-561744e5a9fc req-b622f61d-7894-4db4-bf50-2963752ca3f5 service nova] Releasing lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:16:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-aec774cc-1657-4e97-9bc7-cf4946b759de req-f63f515b-52e7-4621-a2e5-4a595f5224e1 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-aec774cc-1657-4e97-9bc7-cf4946b759de req-f63f515b-52e7-4621-a2e5-4a595f5224e1 service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-aec774cc-1657-4e97-9bc7-cf4946b759de req-f63f515b-52e7-4621-a2e5-4a595f5224e1 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-aec774cc-1657-4e97-9bc7-cf4946b759de req-f63f515b-52e7-4621-a2e5-4a595f5224e1 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-aec774cc-1657-4e97-9bc7-cf4946b759de req-f63f515b-52e7-4621-a2e5-4a595f5224e1 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:16:51 user nova-compute[74889]: WARNING nova.compute.manager [req-aec774cc-1657-4e97-9bc7-cf4946b759de req-f63f515b-52e7-4621-a2e5-4a595f5224e1 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state building and task_state spawning.
Nov 10 12:16:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-e967e5eb-0265-40f8-8d26-0fa953c7b1ad req-7c3ac560-4cec-4462-9505-504955c8e27a service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e967e5eb-0265-40f8-8d26-0fa953c7b1ad req-7c3ac560-4cec-4462-9505-504955c8e27a service nova] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e967e5eb-0265-40f8-8d26-0fa953c7b1ad req-7c3ac560-4cec-4462-9505-504955c8e27a service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e967e5eb-0265-40f8-8d26-0fa953c7b1ad req-7c3ac560-4cec-4462-9505-504955c8e27a service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-e967e5eb-0265-40f8-8d26-0fa953c7b1ad req-7c3ac560-4cec-4462-9505-504955c8e27a service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] No waiting events found dispatching network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:16:51 user nova-compute[74889]: WARNING nova.compute.manager [req-e967e5eb-0265-40f8-8d26-0fa953c7b1ad req-7c3ac560-4cec-4462-9505-504955c8e27a service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received unexpected event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 for instance with vm_state building and task_state spawning.
Nov 10 12:16:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:16:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:16:52 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Instance spawned successfully.
Nov 10 12:16:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:16:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:52 user nova-compute[74889]: INFO nova.compute.manager [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Took 6.60 seconds to spawn the instance on the hypervisor.
Nov 10 12:16:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:16:52 user nova-compute[74889]: INFO nova.compute.manager [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Took 7.26 seconds to build instance.
Nov 10 12:16:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6f3c754a-cf46-4660-b3a1-266c9a0a11ad tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "de32b888-15ed-42eb-9029-1cb3dc471253" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.403s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.compute.manager [req-4cb605c7-b097-44d6-98d9-2111ee9df6a8 req-d7cad00d-ac45-4d0f-b9d3-ee541b41f4c2 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cb605c7-b097-44d6-98d9-2111ee9df6a8 req-d7cad00d-ac45-4d0f-b9d3-ee541b41f4c2 service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cb605c7-b097-44d6-98d9-2111ee9df6a8 req-d7cad00d-ac45-4d0f-b9d3-ee541b41f4c2 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4cb605c7-b097-44d6-98d9-2111ee9df6a8 req-d7cad00d-ac45-4d0f-b9d3-ee541b41f4c2 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.compute.manager [req-4cb605c7-b097-44d6-98d9-2111ee9df6a8 req-d7cad00d-ac45-4d0f-b9d3-ee541b41f4c2 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:16:53 user nova-compute[74889]: WARNING nova.compute.manager [req-4cb605c7-b097-44d6-98d9-2111ee9df6a8 req-d7cad00d-ac45-4d0f-b9d3-ee541b41f4c2 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state active and task_state None.
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.compute.manager [req-687936ca-9bd0-4f99-b662-25fe477a4131 req-c4422b82-bf57-45fe-967f-7d63e9267923 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-687936ca-9bd0-4f99-b662-25fe477a4131 req-c4422b82-bf57-45fe-967f-7d63e9267923 service nova] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-687936ca-9bd0-4f99-b662-25fe477a4131 req-c4422b82-bf57-45fe-967f-7d63e9267923 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-687936ca-9bd0-4f99-b662-25fe477a4131 req-c4422b82-bf57-45fe-967f-7d63e9267923 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.compute.manager [req-687936ca-9bd0-4f99-b662-25fe477a4131 req-c4422b82-bf57-45fe-967f-7d63e9267923 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] No waiting events found dispatching network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:16:53 user nova-compute[74889]: WARNING nova.compute.manager [req-687936ca-9bd0-4f99-b662-25fe477a4131 req-c4422b82-bf57-45fe-967f-7d63e9267923 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received unexpected event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 for instance with vm_state building and task_state spawning.
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:16:53 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Instance spawned successfully.
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:16:53 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:16:53 user nova-compute[74889]: INFO nova.compute.manager [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 10 12:16:53 user nova-compute[74889]: DEBUG nova.compute.manager [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:16:53 user nova-compute[74889]: INFO nova.compute.manager [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Took 6.65 seconds to build instance.
Nov 10 12:16:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-4d17433d-eba9-47a3-aa8e-e60718a4d846 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3824b4fa-25e2-436d-87d8-762353765644" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.801s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:16:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:55 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:16:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:16:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:16:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:16:55 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:16:55 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating instance_info_cache with network_info: [{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG nova.objects.instance [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'flavor' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:57 user nova-compute[74889]: INFO nova.compute.manager [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Attaching volume 3805de67-f621-4513-b3fb-f80c8f938f9b to /dev/vdb
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG os_brick.utils [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:58 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:16:58 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8433MB free_disk=25.301151275634766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2897d65c-aec1-46a8-9048-cda65703d061]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[befa7166-4b18-4de9-990d-cb25ba37f96b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[870ad591-a3e2-4f2e-80bb-3eccd03fb028]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af46002-5cac-41e0-886b-2dffe5c0b9de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:16:58 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:16:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92db266-f786-460a-b1d8-a73aa67bdd32]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG os_brick.utils [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating existing volume attachment record: 278a3f54-d8d3-4734-9f88-ae02345cc714 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:16:58 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:16:59 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:16:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:16:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.514s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:16:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:16:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:16:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:16:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:16:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 12:16:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 12:16:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:01 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:01 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 12:17:02 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:03 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:17:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:10 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:17:13 user nova-compute[74889]: INFO nova.compute.manager [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Rescuing
Nov 10 12:17:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:17:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquired lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:17:13 user nova-compute[74889]: DEBUG nova.network.neutron [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:17:13 user nova-compute[74889]: DEBUG nova.network.neutron [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updating instance_info_cache with network_info: [{"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:17:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Releasing lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:17:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-00b9cfc1-2c65-4475-a3bb-928feacc100c req-8501daf5-955e-4a08-9332-64f842f95123 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-00b9cfc1-2c65-4475-a3bb-928feacc100c req-8501daf5-955e-4a08-9332-64f842f95123 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-00b9cfc1-2c65-4475-a3bb-928feacc100c req-8501daf5-955e-4a08-9332-64f842f95123 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-00b9cfc1-2c65-4475-a3bb-928feacc100c req-8501daf5-955e-4a08-9332-64f842f95123 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-00b9cfc1-2c65-4475-a3bb-928feacc100c req-8501daf5-955e-4a08-9332-64f842f95123 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:17:14 user nova-compute[74889]: WARNING nova.compute.manager [req-00b9cfc1-2c65-4475-a3bb-928feacc100c req-8501daf5-955e-4a08-9332-64f842f95123 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state active and task_state rescuing.
Nov 10 12:17:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:14 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Instance destroyed successfully.
Nov 10 12:17:14 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Attempting a stable device rescue
Nov 10 12:17:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74889) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Instance directory exists: not creating {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 12:17:14 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Creating image(s)
Nov 10 12:17:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "/opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "/opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG nova.objects.instance [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "d44530cff28efa79056b97404f2fcc033fb80b74" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "d44530cff28efa79056b97404f2fcc033fb80b74" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74.part --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:15 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:15 user nova-compute[74889]: DEBUG nova.virt.images [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] 36992f12-d150-4380-9d25-af3d432cafc0 was qcow2, converting to raw {{(pid=74889) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 12:17:15 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:17:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74.part /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74.converted {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-cb08287c-a772-4b3c-9503-0e6c979e0293 req-b102b48c-ce4d-43a3-b01b-055500ca88c9 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb08287c-a772-4b3c-9503-0e6c979e0293 req-b102b48c-ce4d-43a3-b01b-055500ca88c9 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb08287c-a772-4b3c-9503-0e6c979e0293 req-b102b48c-ce4d-43a3-b01b-055500ca88c9 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb08287c-a772-4b3c-9503-0e6c979e0293 req-b102b48c-ce4d-43a3-b01b-055500ca88c9 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-cb08287c-a772-4b3c-9503-0e6c979e0293 req-b102b48c-ce4d-43a3-b01b-055500ca88c9 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:17:16 user nova-compute[74889]: WARNING nova.compute.manager [req-cb08287c-a772-4b3c-9503-0e6c979e0293 req-b102b48c-ce4d-43a3-b01b-055500ca88c9 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state active and task_state rescuing.
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74.part /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74.converted" returned: 0 in 0.488s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74.converted --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74.converted --force-share --output=json" returned: 0 in 0.212s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "d44530cff28efa79056b97404f2fcc033fb80b74" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.935s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "d44530cff28efa79056b97404f2fcc033fb80b74" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "d44530cff28efa79056b97404f2fcc033fb80b74" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74 --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74,backing_fmt=raw /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74,backing_fmt=raw /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue" returned: 0 in 0.050s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "d44530cff28efa79056b97404f2fcc033fb80b74" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.objects.instance [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'migration_context' on Instance uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.objects.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Object Instance<7f361287-3a8c-4422-992d-709d48c7c663> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Start _get_guest_xml network_info=[{"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "vif_mac": "fa:16:3e:69:40:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '36992f12-d150-4380-9d25-af3d432cafc0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vEZCKAdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7f361287-3a8c-4422-992d-709d48c7c663', 'attached_at': '', 'detached_at': '', 'volume_id': '5ce2b95f-67fb-47fe-a193-87bb6e114f05', 'serial': '5ce2b95f-67fb-47fe-a193-87bb6e114f05'}, 'disk_bus': 'virtio', 'attachment_id': '534dcb54-3950-48e1-9d6d-e7bb473a448e', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.objects.instance [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'resources' on Instance uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.objects.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Object Instance<7f361287-3a8c-4422-992d-709d48c7c663> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.objects.instance [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'numa_topology' on Instance uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.objects.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Object Instance<7f361287-3a8c-4422-992d-709d48c7c663> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:17:16 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:17:16 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.objects.instance [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.objects.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Object Instance<7f361287-3a8c-4422-992d-709d48c7c663> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vEZCKAdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:17:16 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:17:16 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:17:16 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b866a7d9-3dc3-41b3-b029-7894d77af320]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vEZCKAdD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 12:17:16 user nova-compute[74889]: node.name = iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:17:16 user nova-compute[74889]: node.tpgt = -1
Nov 10 12:17:16 user nova-compute[74889]: node.startup = automatic
Nov 10 12:17:16 user nova-compute[74889]: node.leading_login = No
Nov 10 12:17:16 user nova-compute[74889]: iface.iscsi_ifacename = default
Nov 10 12:17:16 user nova-compute[74889]: iface.net_ifacename = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.ipaddress = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.prefix_len = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.hwaddress = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.transport_name = tcp
Nov 10 12:17:16 user nova-compute[74889]: iface.initiatorname = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.state = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.vlan_id = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.vlan_priority = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.vlan_state = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.iface_num = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.mtu = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.port = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.bootproto = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.subnet_mask = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.gateway = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.dhcp_alt_client_id = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.dhcp_dns = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.dhcp_learn_iqn = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.dhcp_vendor_id_state = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.dhcp_vendor_id = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.dhcp_slp_da = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.fragmentation = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.gratuitous_arp = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.incoming_forwarding = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.tos_state = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.tos = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.ttl = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.delayed_ack = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.tcp_nagle = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.tcp_wsf_state = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.tcp_wsf = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.tcp_timer_scale = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.tcp_timestamp = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.redirect = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.def_task_mgmt_timeout = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.header_digest = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.data_digest = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.immediate_data = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.initial_r2t = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.data_seq_inorder = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.data_pdu_inorder = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.erl = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.max_receive_data_len = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.first_burst_len = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.max_outstanding_r2t = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.max_burst_len = 0
Nov 10 12:17:16 user nova-compute[74889]: iface.chap_auth = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.bidi_chap = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.strict_login_compliance = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.discovery_auth = <empty>
Nov 10 12:17:16 user nova-compute[74889]: iface.discovery_logout = <empty>
Nov 10 12:17:16 user nova-compute[74889]: node.discovery_address = <empty>
Nov 10 12:17:16 user nova-compute[74889]: node.discovery_port = 0
Nov 10 12:17:16 user nova-compute[74889]: node.discovery_type = static
Nov 10 12:17:16 user nova-compute[74889]: node.session.initial_cmdsn = 0
Nov 10 12:17:16 user nova-compute[74889]: node.session.initial_login_retry_max = 8
Nov 10 12:17:16 user nova-compute[74889]: node.session.xmit_thread_priority = -20
Nov 10 12:17:16 user nova-compute[74889]: node.session.cmds_max = 128
Nov 10 12:17:16 user nova-compute[74889]: node.session.queue_depth = 32
Nov 10 12:17:16 user nova-compute[74889]: node.session.nr_sessions = 1
Nov 10 12:17:16 user nova-compute[74889]: node.session.auth.authmethod = CHAP
Nov 10 12:17:16 user nova-compute[74889]: node.session.auth.username = vEZCKAdD
Nov 10 12:17:16 user nova-compute[74889]: node.session.auth.password = ***
Nov 10 12:17:16 user nova-compute[74889]: node.session.auth.username_in = <empty>
Nov 10 12:17:16 user nova-compute[74889]: node.session.auth.password_in = <empty>
Nov 10 12:17:16 user nova-compute[74889]: node.session.auth.chap_algs = MD5
Nov 10 12:17:16 user nova-compute[74889]: node.session.timeo.replacement_timeout = 120
Nov 10 12:17:16 user nova-compute[74889]: node.session.err_timeo.abort_timeout = 15
Nov 10 12:17:16 user nova-compute[74889]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 12:17:16 user nova-compute[74889]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 12:17:16 user nova-compute[74889]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 12:17:16 user nova-compute[74889]: node.session.iscsi.FastAbort = Yes
Nov 10 12:17:16 user nova-compute[74889]: node.session.iscsi.InitialR2T = No
Nov 10 12:17:16 user nova-compute[74889]: node.session.iscsi.ImmediateData = Yes
Nov 10 12:17:16 user nova-compute[74889]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 12:17:16 user nova-compute[74889]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 12:17:16 user nova-compute[74889]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 12:17:16 user nova-compute[74889]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 12:17:16 user nova-compute[74889]: node.session.iscsi.MaxConnections = 1
Nov 10 12:17:16 user nova-compute[74889]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 12:17:16 user nova-compute[74889]: node.session.iscsi.ERL = 0
Nov 10 12:17:16 user nova-compute[74889]: node.session.scan = manual
Nov 10 12:17:16 user nova-compute[74889]: node.session.reopen_max = 0
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].address = 172.16.0.220
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].port = 3260
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].startup = manual
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].tcp.window_size = 524288
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].tcp.type_of_service = 0
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].timeo.logout_timeout = 15
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].timeo.login_timeout = 15
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].timeo.auth_timeout = 45
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].iscsi.DataDigest = None
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].iscsi.IFMarker = No
Nov 10 12:17:16 user nova-compute[74889]: node.conn[0].iscsi.OFMarker = No
Nov 10 12:17:16 user nova-compute[74889]: # END RECORD
Nov 10 12:17:16 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b9dcc2-7a2c-4a22-b100-32e99e975074]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[03afde1b-7c57-4aa5-b28d-73e746d43ef1]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vEZCKAdD {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vEZCKAdD" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89e7e90-db82-44fb-b653-7ab5dba2a06b]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vEZCKAdD'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[58308254-f2de-4767-9e42-553ffa2a067f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46bcdd3-f1b4-4f85-b56e-d5eeb64bf21f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:17:16 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:17:16 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:17:16 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:17:16 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.136s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] HCTL ('33', '0', '0', 0) found on session 44 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0554d4be-85dc-4857-9f2b-8bbfd1f23005]: (4, ('0 0 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching for a device in session 44 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vEZCKAdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.159s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] <== connect_volume: return (161ms) {'type': 'block', 'scsi_wwn': '26365306339333532', 'path': '/dev/sdb'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365306339333532', 'path': '/dev/sdb'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:15:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-733470210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-733470210',id=39,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:15:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-hi0cjmad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:15:59Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=7f361287-3a8c-4422-992d-709d48c7c663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "vif_mac": "fa:16:3e:69:40:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "vif_mac": "fa:16:3e:69:40:f3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:40:f3,bridge_name='br-int',has_traffic_filtering=True,id=3b04c830-c64d-4813-9b99-a80a2f87cec6,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b04c830-c6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.objects.instance [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.objects.base [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Object Instance<7f361287-3a8c-4422-992d-709d48c7c663> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:17:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:17:16 user nova-compute[74889]:   <uuid>7f361287-3a8c-4422-992d-709d48c7c663</uuid>
Nov 10 12:17:16 user nova-compute[74889]:   <name>instance-00000027</name>
Nov 10 12:17:16 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:17:16 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:17:16 user nova-compute[74889]:   <metadata>
Nov 10 12:17:16 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:17:16 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:17:16 user nova-compute[74889]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-733470210</nova:name>
Nov 10 12:17:16 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:17:16</nova:creationTime>
Nov 10 12:17:16 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:17:16 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:17:16 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:17:16 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:17:16 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:17:16 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:17:16 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:17:16 user nova-compute[74889]:       <nova:owner>
Nov 10 12:17:16 user nova-compute[74889]:         <nova:user uuid="4c2a48cfc9e04a2dbd2ad51b70c8b114">tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member</nova:user>
Nov 10 12:17:16 user nova-compute[74889]:         <nova:project uuid="757eef88e9c04404a1ddedfa23b6031d">tempest-ServerBootFromVolumeStableRescueTest-1484079705</nova:project>
Nov 10 12:17:16 user nova-compute[74889]:       </nova:owner>
Nov 10 12:17:16 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:17:16 user nova-compute[74889]:       <nova:ports>
Nov 10 12:17:16 user nova-compute[74889]:         <nova:port uuid="3b04c830-c64d-4813-9b99-a80a2f87cec6">
Nov 10 12:17:16 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 12:17:16 user nova-compute[74889]:         </nova:port>
Nov 10 12:17:16 user nova-compute[74889]:       </nova:ports>
Nov 10 12:17:16 user nova-compute[74889]:     </nova:instance>
Nov 10 12:17:16 user nova-compute[74889]:   </metadata>
Nov 10 12:17:16 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:17:16 user nova-compute[74889]:     <system>
Nov 10 12:17:16 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:17:16 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:17:16 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:17:16 user nova-compute[74889]:       <entry name="serial">7f361287-3a8c-4422-992d-709d48c7c663</entry>
Nov 10 12:17:16 user nova-compute[74889]:       <entry name="uuid">7f361287-3a8c-4422-992d-709d48c7c663</entry>
Nov 10 12:17:16 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:17:16 user nova-compute[74889]:     </system>
Nov 10 12:17:16 user nova-compute[74889]:   </sysinfo>
Nov 10 12:17:16 user nova-compute[74889]:   <os>
Nov 10 12:17:16 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:17:16 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:17:16 user nova-compute[74889]:   </os>
Nov 10 12:17:16 user nova-compute[74889]:   <features>
Nov 10 12:17:16 user nova-compute[74889]:     <acpi/>
Nov 10 12:17:16 user nova-compute[74889]:     <apic/>
Nov 10 12:17:16 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:17:16 user nova-compute[74889]:   </features>
Nov 10 12:17:16 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:17:16 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:17:16 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:17:16 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:17:16 user nova-compute[74889]:   </clock>
Nov 10 12:17:16 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:17:16 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:17:16 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:17:16 user nova-compute[74889]:   </cpu>
Nov 10 12:17:16 user nova-compute[74889]:   <devices>
Nov 10 12:17:16 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:17:16 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:17:16 user nova-compute[74889]:       <source dev="/dev/sdb"/>
Nov 10 12:17:16 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:17:16 user nova-compute[74889]:       <serial>5ce2b95f-67fb-47fe-a193-87bb6e114f05</serial>
Nov 10 12:17:16 user nova-compute[74889]:     </disk>
Nov 10 12:17:16 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:17:16 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:17:16 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue"/>
Nov 10 12:17:16 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 12:17:16 user nova-compute[74889]:       <boot order="1"/>
Nov 10 12:17:16 user nova-compute[74889]:     </disk>
Nov 10 12:17:16 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:17:16 user nova-compute[74889]:       <mac address="fa:16:3e:69:40:f3"/>
Nov 10 12:17:16 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:17:16 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:17:16 user nova-compute[74889]:       <target dev="tap3b04c830-c6"/>
Nov 10 12:17:16 user nova-compute[74889]:     </interface>
Nov 10 12:17:16 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:17:16 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/console.log" append="off"/>
Nov 10 12:17:16 user nova-compute[74889]:     </serial>
Nov 10 12:17:16 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:17:16 user nova-compute[74889]:     <video>
Nov 10 12:17:16 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:17:16 user nova-compute[74889]:     </video>
Nov 10 12:17:16 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:17:16 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:17:16 user nova-compute[74889]:     </rng>
Nov 10 12:17:16 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:17:16 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:17:16 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:17:16 user nova-compute[74889]:     </memballoon>
Nov 10 12:17:16 user nova-compute[74889]:   </devices>
Nov 10 12:17:16 user nova-compute[74889]: </domain>
Nov 10 12:17:16 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:17:17 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Instance destroyed successfully.
Nov 10 12:17:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:17:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:17:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No VIF found with MAC fa:16:3e:69:40:f3, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:17:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-3c2b5a5e-0bbe-4978-be08-37305324d616 req-6a591aaf-c71d-4cbc-9fd5-d39fe46b2709 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:17:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3c2b5a5e-0bbe-4978-be08-37305324d616 req-6a591aaf-c71d-4cbc-9fd5-d39fe46b2709 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3c2b5a5e-0bbe-4978-be08-37305324d616 req-6a591aaf-c71d-4cbc-9fd5-d39fe46b2709 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3c2b5a5e-0bbe-4978-be08-37305324d616 req-6a591aaf-c71d-4cbc-9fd5-d39fe46b2709 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-3c2b5a5e-0bbe-4978-be08-37305324d616 req-6a591aaf-c71d-4cbc-9fd5-d39fe46b2709 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:17:18 user nova-compute[74889]: WARNING nova.compute.manager [req-3c2b5a5e-0bbe-4978-be08-37305324d616 req-6a591aaf-c71d-4cbc-9fd5-d39fe46b2709 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state active and task_state rescuing.
Nov 10 12:17:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:17:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:17:20 user nova-compute[74889]: WARNING nova.compute.manager [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state active and task_state rescuing.
Nov 10 12:17:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received event network-changed-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:17:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Refreshing instance network info cache due to event network-changed-be7a9750-0602-490c-855b-5f6015d79ebd. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:17:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] Acquiring lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:17:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] Acquired lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:17:20 user nova-compute[74889]: DEBUG nova.network.neutron [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Refreshing network info cache for port be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:17:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-174c6094-7a4f-430f-acbb-968e9a593c97 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:17:21 user nova-compute[74889]: DEBUG nova.network.neutron [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updated VIF entry in instance network info cache for port be7a9750-0602-490c-855b-5f6015d79ebd. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:17:21 user nova-compute[74889]: DEBUG nova.network.neutron [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updating instance_info_cache with network_info: [{"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:17:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2847552c-c678-4244-bed6-0d895670eb91 req-d83cb209-2f0a-4aec-8df8-c26f7bafa622 service nova] Releasing lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:17:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 662a3c8c-e0b0-4dea-b620-d11de1c5a92e {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 3824b4fa-25e2-436d-87d8-762353765644 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "7f361287-3a8c-4422-992d-709d48c7c663" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "de32b888-15ed-42eb-9029-1cb3dc471253" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "3824b4fa-25e2-436d-87d8-762353765644" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "7f361287-3a8c-4422-992d-709d48c7c663" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "de32b888-15ed-42eb-9029-1cb3dc471253" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "3824b4fa-25e2-436d-87d8-762353765644" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid 662a3c8c-e0b0-4dea-b620-d11de1c5a92e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updating instance_info_cache with network_info: [{"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:55 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUdOBolP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:17:56 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:17:56 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:17:56 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[311092c9-d565-42f4-85ba-22f785899e2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:17:56 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d14d29-c56e-4556-a62c-a38288665b06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b] added
Nov 10 12:17:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[254ab44d-1ac0-4970-97c3-731644201ec8]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[87128889-7a60-41e9-b3e9-ed95767c2547]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUdOBolP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUdOBolP" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7730963-d2aa-425d-a573-75cf8d519cbc]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DUdOBolP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5507bcf-a981-4082-839a-96dc415c6081]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d62f5c-a5f6-482d-b65c-d83b3735f696]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:17:56 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:17:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:17:56 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:17:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[73062458-ef6d-45bd-9f82-98c0f6871008]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b, portal: 172.16.0.220,3260]
Nov 10 12:17:56 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b, portal: 172.16.0.220,3260] successful.
Nov 10 12:17:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3816b036-83dd-43ed-a9c8-5094f17f15a0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ed159f-90a4-4c92-8bda-ed3d9f480fa4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:17:56 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:17:56 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:17:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:17:56 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:17:56 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:17:56 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a349598-ab4c-48b2-b67b-e72f8f6852d6]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUdOBolP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23934346130356561', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934346130356561', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG nova.objects.instance [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'flavor' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:17:57 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:17:57 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:17:57 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:17:57 user nova-compute[74889]:   <serial>3805de67-f621-4513-b3fb-f80c8f938f9b</serial>
Nov 10 12:17:57 user nova-compute[74889]: </disk>
Nov 10 12:17:57 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "7bc18e85-4acb-412e-9186-a37a076cf326" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:17:58 user nova-compute[74889]: INFO nova.compute.claims [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Claim successful on node user
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] No VIF found with MAC fa:16:3e:c1:3f:39, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Refreshing inventories for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Updating ProviderTree inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-71094117-e90e-47f6-b3bd-4c7eb3342db5 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 60.657s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.016s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:58 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:17:58 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8181MB free_disk=25.145248413085938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Refreshing aggregate associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, aggregates: None {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Refreshing trait associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.902s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:17:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.307s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:17:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7bc18e85-4acb-412e-9186-a37a076cf326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.policy [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3399214155124a05813668fa635eabcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9145ef914f7547d783ba55a709005576', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:17:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Creating image(s)
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "/opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "/opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "/opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.050s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.205s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk 1073741824" returned: 0 in 0.052s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:59 user nova-compute[74889]: INFO nova.compute.manager [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Rescuing
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquired lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.196s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:17:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Successfully created port: fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Cannot resize image /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Ensure instance console log exists: /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Successfully updated port: fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "refresh_cache-7bc18e85-4acb-412e-9186-a37a076cf326" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquired lock "refresh_cache-7bc18e85-4acb-412e-9186-a37a076cf326" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-2a2ba00b-70b7-4cae-93c0-6f71b8cff81c req-76c3f267-2dd1-4ecb-8edb-b48409cb7bba service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received event network-changed-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-2a2ba00b-70b7-4cae-93c0-6f71b8cff81c req-76c3f267-2dd1-4ecb-8edb-b48409cb7bba service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Refreshing instance network info cache due to event network-changed-fe4493a2-5797-4a0a-9b7f-58b128da4ecd. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2a2ba00b-70b7-4cae-93c0-6f71b8cff81c req-76c3f267-2dd1-4ecb-8edb-b48409cb7bba service nova] Acquiring lock "refresh_cache-7bc18e85-4acb-412e-9186-a37a076cf326" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating instance_info_cache with network_info: [{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Releasing lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Updating instance_info_cache with network_info: [{"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Releasing lock "refresh_cache-7bc18e85-4acb-412e-9186-a37a076cf326" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Instance network_info: |[{"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2a2ba00b-70b7-4cae-93c0-6f71b8cff81c req-76c3f267-2dd1-4ecb-8edb-b48409cb7bba service nova] Acquired lock "refresh_cache-7bc18e85-4acb-412e-9186-a37a076cf326" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.network.neutron [req-2a2ba00b-70b7-4cae-93c0-6f71b8cff81c req-76c3f267-2dd1-4ecb-8edb-b48409cb7bba service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Refreshing network info cache for port fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Start _get_guest_xml network_info=[{"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:18:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:00 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:18:00 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-354119069',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-354119069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3541190',id=43,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc8tJb0VW6ZbqTstUC4mqjgnHfU4HjBfyX2yaT8fLDqyYq4skihjuFMc2t1d2RI+nUU7RiLhMpWgCHn3NWMXeHyiQJcnFlIz/3j1Qaq648e3C2HRmH9T+NUVs1fIwG/3w==',key_name='tempest-keypair-804478842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9145ef914f7547d783ba55a709005576',ramdisk_id='',reservation_id='r-updo9uus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2134497884',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3399214155124a05813668fa635eabcd',uuid=7bc18e85-4acb-412e-9186-a37a076cf326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Converting VIF {"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:75:6c,bridge_name='br-int',has_traffic_filtering=True,id=fe4493a2-5797-4a0a-9b7f-58b128da4ecd,network=Network(24af566c-5acc-4f81-80cb-05ec1accc0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4493a2-57') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bc18e85-4acb-412e-9186-a37a076cf326 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:18:01 user nova-compute[74889]:   <uuid>7bc18e85-4acb-412e-9186-a37a076cf326</uuid>
Nov 10 12:18:01 user nova-compute[74889]:   <name>instance-0000002b</name>
Nov 10 12:18:01 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:18:01 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:18:01 user nova-compute[74889]:   <metadata>
Nov 10 12:18:01 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:18:01 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:18:01 user nova-compute[74889]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-354119069</nova:name>
Nov 10 12:18:01 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:18:00</nova:creationTime>
Nov 10 12:18:01 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:18:01 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:18:01 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:18:01 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:18:01 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:18:01 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:18:01 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:18:01 user nova-compute[74889]:       <nova:owner>
Nov 10 12:18:01 user nova-compute[74889]:         <nova:user uuid="3399214155124a05813668fa635eabcd">tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member</nova:user>
Nov 10 12:18:01 user nova-compute[74889]:         <nova:project uuid="9145ef914f7547d783ba55a709005576">tempest-TestServerVolumeAttachScenarioOldVersion-2134497884</nova:project>
Nov 10 12:18:01 user nova-compute[74889]:       </nova:owner>
Nov 10 12:18:01 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:18:01 user nova-compute[74889]:       <nova:ports>
Nov 10 12:18:01 user nova-compute[74889]:         <nova:port uuid="fe4493a2-5797-4a0a-9b7f-58b128da4ecd">
Nov 10 12:18:01 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 12:18:01 user nova-compute[74889]:         </nova:port>
Nov 10 12:18:01 user nova-compute[74889]:       </nova:ports>
Nov 10 12:18:01 user nova-compute[74889]:     </nova:instance>
Nov 10 12:18:01 user nova-compute[74889]:   </metadata>
Nov 10 12:18:01 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:18:01 user nova-compute[74889]:     <system>
Nov 10 12:18:01 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:18:01 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:18:01 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:18:01 user nova-compute[74889]:       <entry name="serial">7bc18e85-4acb-412e-9186-a37a076cf326</entry>
Nov 10 12:18:01 user nova-compute[74889]:       <entry name="uuid">7bc18e85-4acb-412e-9186-a37a076cf326</entry>
Nov 10 12:18:01 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:18:01 user nova-compute[74889]:     </system>
Nov 10 12:18:01 user nova-compute[74889]:   </sysinfo>
Nov 10 12:18:01 user nova-compute[74889]:   <os>
Nov 10 12:18:01 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:18:01 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:18:01 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:18:01 user nova-compute[74889]:   </os>
Nov 10 12:18:01 user nova-compute[74889]:   <features>
Nov 10 12:18:01 user nova-compute[74889]:     <acpi/>
Nov 10 12:18:01 user nova-compute[74889]:     <apic/>
Nov 10 12:18:01 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:18:01 user nova-compute[74889]:   </features>
Nov 10 12:18:01 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:18:01 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:18:01 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:18:01 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:18:01 user nova-compute[74889]:   </clock>
Nov 10 12:18:01 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:18:01 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:18:01 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:18:01 user nova-compute[74889]:   </cpu>
Nov 10 12:18:01 user nova-compute[74889]:   <devices>
Nov 10 12:18:01 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:18:01 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:18:01 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk"/>
Nov 10 12:18:01 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:18:01 user nova-compute[74889]:     </disk>
Nov 10 12:18:01 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:18:01 user nova-compute[74889]:       <mac address="fa:16:3e:f3:75:6c"/>
Nov 10 12:18:01 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:18:01 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:18:01 user nova-compute[74889]:       <target dev="tapfe4493a2-57"/>
Nov 10 12:18:01 user nova-compute[74889]:     </interface>
Nov 10 12:18:01 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:18:01 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/console.log" append="off"/>
Nov 10 12:18:01 user nova-compute[74889]:     </serial>
Nov 10 12:18:01 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:18:01 user nova-compute[74889]:     <video>
Nov 10 12:18:01 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:18:01 user nova-compute[74889]:     </video>
Nov 10 12:18:01 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:18:01 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:18:01 user nova-compute[74889]:     </rng>
Nov 10 12:18:01 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:18:01 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:18:01 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:18:01 user nova-compute[74889]:     </memballoon>
Nov 10 12:18:01 user nova-compute[74889]:   </devices>
Nov 10 12:18:01 user nova-compute[74889]: </domain>
Nov 10 12:18:01 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-354119069',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-354119069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3541190',id=43,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc8tJb0VW6ZbqTstUC4mqjgnHfU4HjBfyX2yaT8fLDqyYq4skihjuFMc2t1d2RI+nUU7RiLhMpWgCHn3NWMXeHyiQJcnFlIz/3j1Qaq648e3C2HRmH9T+NUVs1fIwG/3w==',key_name='tempest-keypair-804478842',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9145ef914f7547d783ba55a709005576',ramdisk_id='',reservation_id='r-updo9uus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2134497884',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3399214155124a05813668fa635eabcd',uuid=7bc18e85-4acb-412e-9186-a37a076cf326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Converting VIF {"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:75:6c,bridge_name='br-int',has_traffic_filtering=True,id=fe4493a2-5797-4a0a-9b7f-58b128da4ecd,network=Network(24af566c-5acc-4f81-80cb-05ec1accc0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4493a2-57') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG os_vif [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:75:6c,bridge_name='br-int',has_traffic_filtering=True,id=fe4493a2-5797-4a0a-9b7f-58b128da4ecd,network=Network(24af566c-5acc-4f81-80cb-05ec1accc0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4493a2-57') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6899aafc-2184-5112-82f6-8123280d486b', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe4493a2-57, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe4493a2-57, col_values=(('qos', UUID('97ff9e19-63ba-4c28-9297-c543684760db')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe4493a2-57, col_values=(('external_ids', {'iface-id': 'fe4493a2-5797-4a0a-9b7f-58b128da4ecd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:75:6c', 'vm-uuid': '7bc18e85-4acb-412e-9186-a37a076cf326'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:01 user nova-compute[74889]: INFO os_vif [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:75:6c,bridge_name='br-int',has_traffic_filtering=True,id=fe4493a2-5797-4a0a-9b7f-58b128da4ecd,network=Network(24af566c-5acc-4f81-80cb-05ec1accc0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4493a2-57')
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-8caea18a-5f82-4c69-9dd6-4fb69f1ca1c3 req-e99cb4fb-d44a-4fbd-9c24-d49122756718 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8caea18a-5f82-4c69-9dd6-4fb69f1ca1c3 req-e99cb4fb-d44a-4fbd-9c24-d49122756718 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8caea18a-5f82-4c69-9dd6-4fb69f1ca1c3 req-e99cb4fb-d44a-4fbd-9c24-d49122756718 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8caea18a-5f82-4c69-9dd6-4fb69f1ca1c3 req-e99cb4fb-d44a-4fbd-9c24-d49122756718 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-8caea18a-5f82-4c69-9dd6-4fb69f1ca1c3 req-e99cb4fb-d44a-4fbd-9c24-d49122756718 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:01 user nova-compute[74889]: WARNING nova.compute.manager [req-8caea18a-5f82-4c69-9dd6-4fb69f1ca1c3 req-e99cb4fb-d44a-4fbd-9c24-d49122756718 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state active and task_state rescuing.
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] No VIF found with MAC fa:16:3e:f3:75:6c, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.network.neutron [req-2a2ba00b-70b7-4cae-93c0-6f71b8cff81c req-76c3f267-2dd1-4ecb-8edb-b48409cb7bba service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Updated VIF entry in instance network info cache for port fe4493a2-5797-4a0a-9b7f-58b128da4ecd. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG nova.network.neutron [req-2a2ba00b-70b7-4cae-93c0-6f71b8cff81c req-76c3f267-2dd1-4ecb-8edb-b48409cb7bba service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Updating instance_info_cache with network_info: [{"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:18:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2a2ba00b-70b7-4cae-93c0-6f71b8cff81c req-76c3f267-2dd1-4ecb-8edb-b48409cb7bba service nova] Releasing lock "refresh_cache-7bc18e85-4acb-412e-9186-a37a076cf326" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:18:02 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Instance destroyed successfully.
Nov 10 12:18:02 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Attempting a stable device rescue
Nov 10 12:18:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74889) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 12:18:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Instance directory exists: not creating {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 12:18:02 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Creating image(s)
Nov 10 12:18:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:02 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'trusted_certs' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "9e1f686e456745fe3d0cbc411c67ce5062825b65" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "9e1f686e456745fe3d0cbc411c67ce5062825b65" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65.part --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-7cfe2518-eaad-4771-88be-90b0c39b9831 req-ca7c2665-9a50-4601-aa27-17f70b081385 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7cfe2518-eaad-4771-88be-90b0c39b9831 req-ca7c2665-9a50-4601-aa27-17f70b081385 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7cfe2518-eaad-4771-88be-90b0c39b9831 req-ca7c2665-9a50-4601-aa27-17f70b081385 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7cfe2518-eaad-4771-88be-90b0c39b9831 req-ca7c2665-9a50-4601-aa27-17f70b081385 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG nova.compute.manager [req-7cfe2518-eaad-4771-88be-90b0c39b9831 req-ca7c2665-9a50-4601-aa27-17f70b081385 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:03 user nova-compute[74889]: WARNING nova.compute.manager [req-7cfe2518-eaad-4771-88be-90b0c39b9831 req-ca7c2665-9a50-4601-aa27-17f70b081385 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state active and task_state rescuing.
Nov 10 12:18:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65.part --force-share --output=json" returned: 0 in 0.236s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG nova.virt.images [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] 1a63b5ae-c1ee-4783-b7bc-c5ba1ed5d0e8 was qcow2, converting to raw {{(pid=74889) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:18:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65.part /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65.converted {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65.part /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65.converted" returned: 0 in 0.638s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65.converted --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "9e1f686e456745fe3d0cbc411c67ce5062825b65" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.342s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "9e1f686e456745fe3d0cbc411c67ce5062825b65" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "9e1f686e456745fe3d0cbc411c67ce5062825b65" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65 --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.compute.manager [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65 --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65,backing_fmt=raw /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.rescue {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65,backing_fmt=raw /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.rescue" returned: 0 in 0.056s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "9e1f686e456745fe3d0cbc411c67ce5062825b65" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'migration_context' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.objects.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Object Instance<903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Start _get_guest_xml network_info=[{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "vif_mac": "fa:16:3e:c1:3f:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1a63b5ae-c1ee-4783-b7bc-c5ba1ed5d0e8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUdOBolP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4', 'attached_at': '', 'detached_at': '', 'volume_id': '3805de67-f621-4513-b3fb-f80c8f938f9b', 'serial': '3805de67-f621-4513-b3fb-f80c8f938f9b'}, 'disk_bus': 'virtio', 'attachment_id': '278a3f54-d8d3-4734-9f88-ae02345cc714', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'resources' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:18:04 user nova-compute[74889]: INFO nova.compute.claims [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Claim successful on node user
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.objects.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Object Instance<903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'numa_topology' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.objects.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Object Instance<903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:18:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:18:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:18:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'vcpu_model' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.objects.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Object Instance<903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUdOBolP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:18:05 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:18:05 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:18:05 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c2fe77-ce64-477a-af23-9a085402b886]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DUdOBolP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 12:18:05 user nova-compute[74889]: node.name = iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b
Nov 10 12:18:05 user nova-compute[74889]: node.tpgt = -1
Nov 10 12:18:05 user nova-compute[74889]: node.startup = automatic
Nov 10 12:18:05 user nova-compute[74889]: node.leading_login = No
Nov 10 12:18:05 user nova-compute[74889]: iface.iscsi_ifacename = default
Nov 10 12:18:05 user nova-compute[74889]: iface.net_ifacename = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.ipaddress = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.prefix_len = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.hwaddress = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.transport_name = tcp
Nov 10 12:18:05 user nova-compute[74889]: iface.initiatorname = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.state = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.vlan_id = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.vlan_priority = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.vlan_state = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.iface_num = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.mtu = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.port = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.bootproto = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.subnet_mask = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.gateway = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.dhcp_alt_client_id = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.dhcp_dns = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.dhcp_learn_iqn = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.dhcp_vendor_id_state = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.dhcp_vendor_id = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.dhcp_slp_da = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.fragmentation = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.gratuitous_arp = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.incoming_forwarding = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.tos_state = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.tos = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.ttl = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.delayed_ack = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.tcp_nagle = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.tcp_wsf_state = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.tcp_wsf = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.tcp_timer_scale = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.tcp_timestamp = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.redirect = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.def_task_mgmt_timeout = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.header_digest = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.data_digest = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.immediate_data = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.initial_r2t = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.data_seq_inorder = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.data_pdu_inorder = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.erl = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.max_receive_data_len = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.first_burst_len = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.max_outstanding_r2t = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.max_burst_len = 0
Nov 10 12:18:05 user nova-compute[74889]: iface.chap_auth = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.bidi_chap = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.strict_login_compliance = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.discovery_auth = <empty>
Nov 10 12:18:05 user nova-compute[74889]: iface.discovery_logout = <empty>
Nov 10 12:18:05 user nova-compute[74889]: node.discovery_address = <empty>
Nov 10 12:18:05 user nova-compute[74889]: node.discovery_port = 0
Nov 10 12:18:05 user nova-compute[74889]: node.discovery_type = static
Nov 10 12:18:05 user nova-compute[74889]: node.session.initial_cmdsn = 0
Nov 10 12:18:05 user nova-compute[74889]: node.session.initial_login_retry_max = 8
Nov 10 12:18:05 user nova-compute[74889]: node.session.xmit_thread_priority = -20
Nov 10 12:18:05 user nova-compute[74889]: node.session.cmds_max = 128
Nov 10 12:18:05 user nova-compute[74889]: node.session.queue_depth = 32
Nov 10 12:18:05 user nova-compute[74889]: node.session.nr_sessions = 1
Nov 10 12:18:05 user nova-compute[74889]: node.session.auth.authmethod = CHAP
Nov 10 12:18:05 user nova-compute[74889]: node.session.auth.username = DUdOBolP
Nov 10 12:18:05 user nova-compute[74889]: node.session.auth.password = ***
Nov 10 12:18:05 user nova-compute[74889]: node.session.auth.username_in = <empty>
Nov 10 12:18:05 user nova-compute[74889]: node.session.auth.password_in = <empty>
Nov 10 12:18:05 user nova-compute[74889]: node.session.auth.chap_algs = MD5
Nov 10 12:18:05 user nova-compute[74889]: node.session.timeo.replacement_timeout = 120
Nov 10 12:18:05 user nova-compute[74889]: node.session.err_timeo.abort_timeout = 15
Nov 10 12:18:05 user nova-compute[74889]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 12:18:05 user nova-compute[74889]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 12:18:05 user nova-compute[74889]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 12:18:05 user nova-compute[74889]: node.session.iscsi.FastAbort = Yes
Nov 10 12:18:05 user nova-compute[74889]: node.session.iscsi.InitialR2T = No
Nov 10 12:18:05 user nova-compute[74889]: node.session.iscsi.ImmediateData = Yes
Nov 10 12:18:05 user nova-compute[74889]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 12:18:05 user nova-compute[74889]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 12:18:05 user nova-compute[74889]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 12:18:05 user nova-compute[74889]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 12:18:05 user nova-compute[74889]: node.session.iscsi.MaxConnections = 1
Nov 10 12:18:05 user nova-compute[74889]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 12:18:05 user nova-compute[74889]: node.session.iscsi.ERL = 0
Nov 10 12:18:05 user nova-compute[74889]: node.session.scan = manual
Nov 10 12:18:05 user nova-compute[74889]: node.session.reopen_max = 0
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].address = 172.16.0.220
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].port = 3260
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].startup = manual
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].tcp.window_size = 524288
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].tcp.type_of_service = 0
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].timeo.logout_timeout = 15
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].timeo.login_timeout = 15
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].timeo.auth_timeout = 45
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].iscsi.DataDigest = None
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].iscsi.IFMarker = No
Nov 10 12:18:05 user nova-compute[74889]: node.conn[0].iscsi.OFMarker = No
Nov 10 12:18:05 user nova-compute[74889]: # END RECORD
Nov 10 12:18:05 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98e8864-bae2-416b-b990-f3f9a3a9f60e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb48a87-82e1-4f36-98cb-151cb1356cbd]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUdOBolP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DUdOBolP" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e500d1-db81-4d53-84b7-be7dcde0a12a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DUdOBolP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0744af76-46d6-437d-b13c-2ab9ea6eb614]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b741ed-c535-4867-862b-6740cd861775]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:18:05 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:18:05 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:18:05 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:18:05 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:18:05 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:18:05 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.182s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] HCTL ('35', '0', '0', 0) found on session 46 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[77621d00-28d9-44c6-9aee-260aa48b500f]: (4, ('0 0 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Searching for a device in session 46 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUdOBolP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.208s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '23934346130356561', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934346130356561', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-137397044',display_name='tempest-ServerStableDeviceRescueTest-server-137397044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-137397044',id=38,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPiHED/O3YxLE3/Pozk1GrEwY9VoJaFyDb5ArKwcg5/nUF6NifLRMQLba9hOy2RYEEK6YhuTdNvZMDr9wwXh2lyTycQbYofYq9VLGyvvTKR+N5oDM7jKla4GRF4HwEP3w==',key_name='tempest-keypair-1720706475',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:13:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f2235110fb74639b0d81ee2c7586b8b',ramdisk_id='',reservation_id='r-8f9jgm34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1835119920',owner_user_name='tempest-ServerStableDeviceRescueTest-1835119920-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:15:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37f23ef8bc05432096fc0bbeb4b29aca',uuid=903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "vif_mac": "fa:16:3e:c1:3f:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Converting VIF {"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "vif_mac": "fa:16:3e:c1:3f:39"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:39,bridge_name='br-int',has_traffic_filtering=True,id=4c1e4117-f6a1-46d7-9864-d17dacfd1eea,network=Network(184818ba-92f6-4840-89da-7721d94fb9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e4117-f6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'pci_devices' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.objects.base [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Object Instance<903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:18:05 user nova-compute[74889]:   <uuid>903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4</uuid>
Nov 10 12:18:05 user nova-compute[74889]:   <name>instance-00000026</name>
Nov 10 12:18:05 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:18:05 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:18:05 user nova-compute[74889]:   <metadata>
Nov 10 12:18:05 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:18:05 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:18:05 user nova-compute[74889]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-137397044</nova:name>
Nov 10 12:18:05 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:18:04</nova:creationTime>
Nov 10 12:18:05 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:18:05 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:18:05 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:18:05 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:18:05 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:18:05 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:18:05 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:18:05 user nova-compute[74889]:       <nova:owner>
Nov 10 12:18:05 user nova-compute[74889]:         <nova:user uuid="37f23ef8bc05432096fc0bbeb4b29aca">tempest-ServerStableDeviceRescueTest-1835119920-project-member</nova:user>
Nov 10 12:18:05 user nova-compute[74889]:         <nova:project uuid="1f2235110fb74639b0d81ee2c7586b8b">tempest-ServerStableDeviceRescueTest-1835119920</nova:project>
Nov 10 12:18:05 user nova-compute[74889]:       </nova:owner>
Nov 10 12:18:05 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:18:05 user nova-compute[74889]:       <nova:ports>
Nov 10 12:18:05 user nova-compute[74889]:         <nova:port uuid="4c1e4117-f6a1-46d7-9864-d17dacfd1eea">
Nov 10 12:18:05 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 12:18:05 user nova-compute[74889]:         </nova:port>
Nov 10 12:18:05 user nova-compute[74889]:       </nova:ports>
Nov 10 12:18:05 user nova-compute[74889]:     </nova:instance>
Nov 10 12:18:05 user nova-compute[74889]:   </metadata>
Nov 10 12:18:05 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:18:05 user nova-compute[74889]:     <system>
Nov 10 12:18:05 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:18:05 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:18:05 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:18:05 user nova-compute[74889]:       <entry name="serial">903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4</entry>
Nov 10 12:18:05 user nova-compute[74889]:       <entry name="uuid">903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4</entry>
Nov 10 12:18:05 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:18:05 user nova-compute[74889]:     </system>
Nov 10 12:18:05 user nova-compute[74889]:   </sysinfo>
Nov 10 12:18:05 user nova-compute[74889]:   <os>
Nov 10 12:18:05 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:18:05 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:18:05 user nova-compute[74889]:   </os>
Nov 10 12:18:05 user nova-compute[74889]:   <features>
Nov 10 12:18:05 user nova-compute[74889]:     <acpi/>
Nov 10 12:18:05 user nova-compute[74889]:     <apic/>
Nov 10 12:18:05 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:18:05 user nova-compute[74889]:   </features>
Nov 10 12:18:05 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:18:05 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:18:05 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:18:05 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:18:05 user nova-compute[74889]:   </clock>
Nov 10 12:18:05 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:18:05 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:18:05 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:18:05 user nova-compute[74889]:   </cpu>
Nov 10 12:18:05 user nova-compute[74889]:   <devices>
Nov 10 12:18:05 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:18:05 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:18:05 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk"/>
Nov 10 12:18:05 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:18:05 user nova-compute[74889]:     </disk>
Nov 10 12:18:05 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:18:05 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:18:05 user nova-compute[74889]:       <source dev="/dev/sdd"/>
Nov 10 12:18:05 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 12:18:05 user nova-compute[74889]:       <serial>3805de67-f621-4513-b3fb-f80c8f938f9b</serial>
Nov 10 12:18:05 user nova-compute[74889]:     </disk>
Nov 10 12:18:05 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:18:05 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:18:05 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.rescue"/>
Nov 10 12:18:05 user nova-compute[74889]:       <target dev="vdc" bus="virtio"/>
Nov 10 12:18:05 user nova-compute[74889]:       <boot order="1"/>
Nov 10 12:18:05 user nova-compute[74889]:     </disk>
Nov 10 12:18:05 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:18:05 user nova-compute[74889]:       <mac address="fa:16:3e:c1:3f:39"/>
Nov 10 12:18:05 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:18:05 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:18:05 user nova-compute[74889]:       <target dev="tap4c1e4117-f6"/>
Nov 10 12:18:05 user nova-compute[74889]:     </interface>
Nov 10 12:18:05 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:18:05 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/console.log" append="off"/>
Nov 10 12:18:05 user nova-compute[74889]:     </serial>
Nov 10 12:18:05 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:18:05 user nova-compute[74889]:     <video>
Nov 10 12:18:05 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:18:05 user nova-compute[74889]:     </video>
Nov 10 12:18:05 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:18:05 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:18:05 user nova-compute[74889]:     </rng>
Nov 10 12:18:05 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:18:05 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:18:05 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:18:05 user nova-compute[74889]:     </memballoon>
Nov 10 12:18:05 user nova-compute[74889]:   </devices>
Nov 10 12:18:05 user nova-compute[74889]: </domain>
Nov 10 12:18:05 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:18:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Instance destroyed successfully.
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] No VIF found with MAC fa:16:3e:c1:3f:39, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.network.neutron [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:18:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received event network-vif-plugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] Acquiring lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] Lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] Lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] No waiting events found dispatching network-vif-plugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:05 user nova-compute[74889]: WARNING nova.compute.manager [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received unexpected event network-vif-plugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd for instance with vm_state building and task_state spawning.
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received event network-vif-plugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] Acquiring lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] Lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] Lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] No waiting events found dispatching network-vif-plugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:05 user nova-compute[74889]: WARNING nova.compute.manager [req-b0704d78-613f-4500-a5d0-29d622e19693 req-44872741-2356-4198-9b73-c59a92d9671d service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received unexpected event network-vif-plugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd for instance with vm_state building and task_state spawning.
Nov 10 12:18:05 user nova-compute[74889]: INFO nova.virt.block_device [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Booting with volume 96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 at /dev/vda
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.policy [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b53b32c4dd094fb4a4b0618dc619b21f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e703b195816426d9054c28fa6cd15cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.utils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb68fc2f-9e70-476e-8c24-1e9f82759795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde28615-7ab7-4f44-94c4-805b5846f9ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fc2f12-9ae0-4c16-a014-a15ba26bdd61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9e6d6-4380-4380-8bb9-56d59aa48b5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:18:05 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:18:05 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[354c95b8-1c00-4544-b4d6-3548e0800e03]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG os_brick.utils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:18:05 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Updating existing volume attachment record: 48148c59-f58d-4393-a098-13bb7b763e57 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:18:06 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Instance spawned successfully.
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:06 user nova-compute[74889]: INFO nova.compute.manager [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Took 7.06 seconds to spawn the instance on the hypervisor.
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:18:06 user nova-compute[74889]: INFO nova.compute.manager [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Took 8.41 seconds to build instance.
Nov 10 12:18:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1a6f1c2e-44b1-4f94-ae76-6186afea773c tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.535s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG nova.network.neutron [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Successfully created port: 19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.network.neutron [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Successfully updated port: 19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquired lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.network.neutron [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-19ea1e5b-9378-407e-bb60-49750d026ab5 req-23ba4ade-47bb-4c5b-a473-4dc62b51e046 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received event network-changed-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-19ea1e5b-9378-407e-bb60-49750d026ab5 req-23ba4ade-47bb-4c5b-a473-4dc62b51e046 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Refreshing instance network info cache due to event network-changed-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-19ea1e5b-9378-407e-bb60-49750d026ab5 req-23ba4ade-47bb-4c5b-a473-4dc62b51e046 service nova] Acquiring lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.network.neutron [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:07 user nova-compute[74889]: WARNING nova.compute.manager [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state active and task_state rescuing.
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:07 user nova-compute[74889]: WARNING nova.compute.manager [req-3038f09b-3856-45f5-98e6-d8b209469490 req-475a3dc0-0068-43c1-ae62-acece1fcea37 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state active and task_state rescuing.
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.network.neutron [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Updating instance_info_cache with network_info: [{"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Releasing lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.compute.manager [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Instance network_info: |[{"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-19ea1e5b-9378-407e-bb60-49750d026ab5 req-23ba4ade-47bb-4c5b-a473-4dc62b51e046 service nova] Acquired lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:18:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-19ea1e5b-9378-407e-bb60-49750d026ab5 req-23ba4ade-47bb-4c5b-a473-4dc62b51e046 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Refreshing network info cache for port 19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:18:08 user nova-compute[74889]: DEBUG nova.network.neutron [req-19ea1e5b-9378-407e-bb60-49750d026ab5 req-23ba4ade-47bb-4c5b-a473-4dc62b51e046 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Updated VIF entry in instance network info cache for port 19ddbdd8-c5e6-4c82-8c59-0d62929dbef2. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:18:08 user nova-compute[74889]: DEBUG nova.network.neutron [req-19ea1e5b-9378-407e-bb60-49750d026ab5 req-23ba4ade-47bb-4c5b-a473-4dc62b51e046 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Updating instance_info_cache with network_info: [{"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:18:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-19ea1e5b-9378-407e-bb60-49750d026ab5 req-23ba4ade-47bb-4c5b-a473-4dc62b51e046 service nova] Releasing lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:18:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ada3f8d5-38de-40f1-b444-efefe2f633c2 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:18:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:10 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:18:10 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:18:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:18:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:18:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:18:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:18:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:37 user nova-compute[74889]: INFO nova.compute.manager [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Rescuing
Nov 10 12:18:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquired lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG nova.network.neutron [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG nova.network.neutron [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updating instance_info_cache with network_info: [{"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Releasing lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-9f0983cc-3676-4b1b-a393-5f665a84561e req-daea6ab7-726d-4497-b23c-e902620fc831 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-vif-unplugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f0983cc-3676-4b1b-a393-5f665a84561e req-daea6ab7-726d-4497-b23c-e902620fc831 service nova] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f0983cc-3676-4b1b-a393-5f665a84561e req-daea6ab7-726d-4497-b23c-e902620fc831 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f0983cc-3676-4b1b-a393-5f665a84561e req-daea6ab7-726d-4497-b23c-e902620fc831 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-9f0983cc-3676-4b1b-a393-5f665a84561e req-daea6ab7-726d-4497-b23c-e902620fc831 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] No waiting events found dispatching network-vif-unplugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:37 user nova-compute[74889]: WARNING nova.compute.manager [req-9f0983cc-3676-4b1b-a393-5f665a84561e req-daea6ab7-726d-4497-b23c-e902620fc831 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received unexpected event network-vif-unplugged-66f57458-b8da-4024-bff4-6985155568a7 for instance with vm_state active and task_state rescuing.
Nov 10 12:18:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:38 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Instance destroyed successfully.
Nov 10 12:18:38 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Attempting rescue
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74889) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Instance directory exists: not creating {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 12:18:38 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Creating image(s)
Nov 10 12:18:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3824b4fa-25e2-436d-87d8-762353765644 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.218s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue" returned: 0 in 0.047s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'migration_context' on Instance uuid 3824b4fa-25e2-436d-87d8-762353765644 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.base [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<3824b4fa-25e2-436d-87d8-762353765644> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Start _get_guest_xml network_info=[{"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "vif_mac": "fa:16:3e:03:61:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'resources' on Instance uuid 3824b4fa-25e2-436d-87d8-762353765644 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.base [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<3824b4fa-25e2-436d-87d8-762353765644> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'numa_topology' on Instance uuid 3824b4fa-25e2-436d-87d8-762353765644 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.base [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<3824b4fa-25e2-436d-87d8-762353765644> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:18:38 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:18:38 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3824b4fa-25e2-436d-87d8-762353765644 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.base [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<3824b4fa-25e2-436d-87d8-762353765644> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-128065686',display_name='tempest-ServerRescueNegativeTestJSON-server-128065686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-128065686',id=42,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:16:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-vw8fbr6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:16:54Z,user_data=None,user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=3824b4fa-25e2-436d-87d8-762353765644,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "vif_mac": "fa:16:3e:03:61:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "vif_mac": "fa:16:3e:03:61:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:61:9b,bridge_name='br-int',has_traffic_filtering=True,id=66f57458-b8da-4024-bff4-6985155568a7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f57458-b8') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'pci_devices' on Instance uuid 3824b4fa-25e2-436d-87d8-762353765644 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.objects.base [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<3824b4fa-25e2-436d-87d8-762353765644> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:18:38 user nova-compute[74889]:   <uuid>3824b4fa-25e2-436d-87d8-762353765644</uuid>
Nov 10 12:18:38 user nova-compute[74889]:   <name>instance-0000002a</name>
Nov 10 12:18:38 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:18:38 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:18:38 user nova-compute[74889]:   <metadata>
Nov 10 12:18:38 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:18:38 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:18:38 user nova-compute[74889]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-128065686</nova:name>
Nov 10 12:18:38 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:18:38</nova:creationTime>
Nov 10 12:18:38 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:18:38 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:18:38 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:18:38 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:18:38 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:18:38 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:18:38 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:18:38 user nova-compute[74889]:       <nova:owner>
Nov 10 12:18:38 user nova-compute[74889]:         <nova:user uuid="db6e671b33f14840b2a79a3affbbaaa8">tempest-ServerRescueNegativeTestJSON-524488673-project-member</nova:user>
Nov 10 12:18:38 user nova-compute[74889]:         <nova:project uuid="62c4b9efdfb14eadb63b747cc3c6003f">tempest-ServerRescueNegativeTestJSON-524488673</nova:project>
Nov 10 12:18:38 user nova-compute[74889]:       </nova:owner>
Nov 10 12:18:38 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:18:38 user nova-compute[74889]:       <nova:ports>
Nov 10 12:18:38 user nova-compute[74889]:         <nova:port uuid="66f57458-b8da-4024-bff4-6985155568a7">
Nov 10 12:18:38 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 12:18:38 user nova-compute[74889]:         </nova:port>
Nov 10 12:18:38 user nova-compute[74889]:       </nova:ports>
Nov 10 12:18:38 user nova-compute[74889]:     </nova:instance>
Nov 10 12:18:38 user nova-compute[74889]:   </metadata>
Nov 10 12:18:38 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:18:38 user nova-compute[74889]:     <system>
Nov 10 12:18:38 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:18:38 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:18:38 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:18:38 user nova-compute[74889]:       <entry name="serial">3824b4fa-25e2-436d-87d8-762353765644</entry>
Nov 10 12:18:38 user nova-compute[74889]:       <entry name="uuid">3824b4fa-25e2-436d-87d8-762353765644</entry>
Nov 10 12:18:38 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:18:38 user nova-compute[74889]:     </system>
Nov 10 12:18:38 user nova-compute[74889]:   </sysinfo>
Nov 10 12:18:38 user nova-compute[74889]:   <os>
Nov 10 12:18:38 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:18:38 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:18:38 user nova-compute[74889]:   </os>
Nov 10 12:18:38 user nova-compute[74889]:   <features>
Nov 10 12:18:38 user nova-compute[74889]:     <acpi/>
Nov 10 12:18:38 user nova-compute[74889]:     <apic/>
Nov 10 12:18:38 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:18:38 user nova-compute[74889]:   </features>
Nov 10 12:18:38 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:18:38 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:18:38 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:18:38 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:18:38 user nova-compute[74889]:   </clock>
Nov 10 12:18:38 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:18:38 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:18:38 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:18:38 user nova-compute[74889]:   </cpu>
Nov 10 12:18:38 user nova-compute[74889]:   <devices>
Nov 10 12:18:38 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:18:38 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:18:38 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue"/>
Nov 10 12:18:38 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:18:38 user nova-compute[74889]:     </disk>
Nov 10 12:18:38 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:18:38 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:18:38 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk"/>
Nov 10 12:18:38 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 12:18:38 user nova-compute[74889]:     </disk>
Nov 10 12:18:38 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:18:38 user nova-compute[74889]:       <mac address="fa:16:3e:03:61:9b"/>
Nov 10 12:18:38 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:18:38 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:18:38 user nova-compute[74889]:       <target dev="tap66f57458-b8"/>
Nov 10 12:18:38 user nova-compute[74889]:     </interface>
Nov 10 12:18:38 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:18:38 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/console.log" append="off"/>
Nov 10 12:18:38 user nova-compute[74889]:     </serial>
Nov 10 12:18:38 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:18:38 user nova-compute[74889]:     <video>
Nov 10 12:18:38 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:18:38 user nova-compute[74889]:     </video>
Nov 10 12:18:38 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:18:38 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:18:38 user nova-compute[74889]:     </rng>
Nov 10 12:18:38 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:18:38 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:18:38 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:18:38 user nova-compute[74889]:     </memballoon>
Nov 10 12:18:38 user nova-compute[74889]:   </devices>
Nov 10 12:18:38 user nova-compute[74889]: </domain>
Nov 10 12:18:38 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:18:38 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Instance destroyed successfully.
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:18:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No VIF found with MAC fa:16:3e:03:61:9b, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.compute.manager [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:18:39 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Creating image(s)
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Ensure instance console log exists: /opt/stack/data/nova/instances/983c8d72-90c5-44c9-9480-19c7f5cab3eb/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Start _get_guest_xml network_info=[{"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XRBCGoiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '983c8d72-90c5-44c9-9480-19c7f5cab3eb', 'attached_at': '', 'detached_at': '', 'volume_id': '96c38a1d-6e36-4838-a5f9-0d15e9ee66e4', 'serial': '96c38a1d-6e36-4838-a5f9-0d15e9ee66e4'}, 'disk_bus': 'virtio', 'attachment_id': '48148c59-f58d-4393-a098-13bb7b763e57', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:18:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:18:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XRBCGoiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:18:39 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:18:39 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:18:39 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c0fb25-ff0f-4180-9669-53fdd7cf7131]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:18:39 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-207eadf1-61d7-45e3-bb87-b3ece5a61340 req-682de320-6c23-4b8b-ac53-f3dcd5448974 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-207eadf1-61d7-45e3-bb87-b3ece5a61340 req-682de320-6c23-4b8b-ac53-f3dcd5448974 service nova] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-207eadf1-61d7-45e3-bb87-b3ece5a61340 req-682de320-6c23-4b8b-ac53-f3dcd5448974 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-207eadf1-61d7-45e3-bb87-b3ece5a61340 req-682de320-6c23-4b8b-ac53-f3dcd5448974 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG nova.compute.manager [req-207eadf1-61d7-45e3-bb87-b3ece5a61340 req-682de320-6c23-4b8b-ac53-f3dcd5448974 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] No waiting events found dispatching network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:39 user nova-compute[74889]: WARNING nova.compute.manager [req-207eadf1-61d7-45e3-bb87-b3ece5a61340 req-682de320-6c23-4b8b-ac53-f3dcd5448974 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received unexpected event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 for instance with vm_state active and task_state rescuing.
Nov 10 12:18:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b9f6c0-31c7-4128-9a8a-59bc77a53d56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4] added
Nov 10 12:18:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d7c204-a59e-44d1-a58b-07bd94104175]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a21f2a3-69e0-4e1e-b8fd-1a452b6ce99d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XRBCGoiF {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XRBCGoiF" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d86079-0752-4f09-93e8-0f0bbc2971fd]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XRBCGoiF'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a797b231-6be0-4a3c-a97b-0043c4242970]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c2915d-a9b2-4f1f-b151-3b0d017153cc]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:18:40 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:18:40 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:18:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:18:40 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:18:40 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:18:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[895e2488-2707-4909-af07-6d4fb34600eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4, portal: 172.16.0.220,3260]
Nov 10 12:18:40 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4, portal: 172.16.0.220,3260] successful.
Nov 10 12:18:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[056ecfac-6a33-43ac-8a98-f4af86c97664]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8def97-a3e2-4aae-8b81-0c1d31509cbc]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:18:40 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:18:40 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:18:40 user nova-compute[74889]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 (non-flash)
Nov 10 12:18:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:18:40 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:18:40 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:18:40 user nova-compute[74889]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 (non-flash)
Nov 10 12:18:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ebec8-7269-449c-8922-ca8dd6bc0701]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XRBCGoiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23831343432666662', 'path': '/dev/sde'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831343432666662', 'path': '/dev/sde'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2105373756',display_name='tempest-TestVolumeBootPattern-server-2105373756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2105373756',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5sI8i7f1ePG/W7UaO+8+gsVMkmIp2O9S2Zp/OA7rnj2vqp7KJJD0civJv0L7iUGqDlP4rsFJ2tgFLkt5XPKycZVXji+0bjZyXuGwJUvRKhSllkY2ECb15wAksxQrkIeg==',key_name='tempest-TestVolumeBootPattern-597466952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-245rf9jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:18:06Z,user_data=None,user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=983c8d72-90c5-44c9-9480-19c7f5cab3eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:8f:90,bridge_name='br-int',has_traffic_filtering=True,id=19ddbdd8-c5e6-4c82-8c59-0d62929dbef2,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ddbdd8-c5') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.objects.instance [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lazy-loading 'pci_devices' on Instance uuid 983c8d72-90c5-44c9-9480-19c7f5cab3eb {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:18:41 user nova-compute[74889]:   <uuid>983c8d72-90c5-44c9-9480-19c7f5cab3eb</uuid>
Nov 10 12:18:41 user nova-compute[74889]:   <name>instance-0000002c</name>
Nov 10 12:18:41 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:18:41 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:18:41 user nova-compute[74889]:   <metadata>
Nov 10 12:18:41 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:18:41 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:18:41 user nova-compute[74889]:       <nova:name>tempest-TestVolumeBootPattern-server-2105373756</nova:name>
Nov 10 12:18:41 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:18:39</nova:creationTime>
Nov 10 12:18:41 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:18:41 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:18:41 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:18:41 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:18:41 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:18:41 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:18:41 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:18:41 user nova-compute[74889]:       <nova:owner>
Nov 10 12:18:41 user nova-compute[74889]:         <nova:user uuid="b53b32c4dd094fb4a4b0618dc619b21f">tempest-TestVolumeBootPattern-1577456798-project-member</nova:user>
Nov 10 12:18:41 user nova-compute[74889]:         <nova:project uuid="1e703b195816426d9054c28fa6cd15cc">tempest-TestVolumeBootPattern-1577456798</nova:project>
Nov 10 12:18:41 user nova-compute[74889]:       </nova:owner>
Nov 10 12:18:41 user nova-compute[74889]:       <nova:ports>
Nov 10 12:18:41 user nova-compute[74889]:         <nova:port uuid="19ddbdd8-c5e6-4c82-8c59-0d62929dbef2">
Nov 10 12:18:41 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 12:18:41 user nova-compute[74889]:         </nova:port>
Nov 10 12:18:41 user nova-compute[74889]:       </nova:ports>
Nov 10 12:18:41 user nova-compute[74889]:     </nova:instance>
Nov 10 12:18:41 user nova-compute[74889]:   </metadata>
Nov 10 12:18:41 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:18:41 user nova-compute[74889]:     <system>
Nov 10 12:18:41 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:18:41 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:18:41 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:18:41 user nova-compute[74889]:       <entry name="serial">983c8d72-90c5-44c9-9480-19c7f5cab3eb</entry>
Nov 10 12:18:41 user nova-compute[74889]:       <entry name="uuid">983c8d72-90c5-44c9-9480-19c7f5cab3eb</entry>
Nov 10 12:18:41 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:18:41 user nova-compute[74889]:     </system>
Nov 10 12:18:41 user nova-compute[74889]:   </sysinfo>
Nov 10 12:18:41 user nova-compute[74889]:   <os>
Nov 10 12:18:41 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:18:41 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:18:41 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:18:41 user nova-compute[74889]:   </os>
Nov 10 12:18:41 user nova-compute[74889]:   <features>
Nov 10 12:18:41 user nova-compute[74889]:     <acpi/>
Nov 10 12:18:41 user nova-compute[74889]:     <apic/>
Nov 10 12:18:41 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:18:41 user nova-compute[74889]:   </features>
Nov 10 12:18:41 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:18:41 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:18:41 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:18:41 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:18:41 user nova-compute[74889]:   </clock>
Nov 10 12:18:41 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:18:41 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:18:41 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:18:41 user nova-compute[74889]:   </cpu>
Nov 10 12:18:41 user nova-compute[74889]:   <devices>
Nov 10 12:18:41 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:18:41 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:18:41 user nova-compute[74889]:       <source dev="/dev/sde"/>
Nov 10 12:18:41 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:18:41 user nova-compute[74889]:       <serial>96c38a1d-6e36-4838-a5f9-0d15e9ee66e4</serial>
Nov 10 12:18:41 user nova-compute[74889]:     </disk>
Nov 10 12:18:41 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:18:41 user nova-compute[74889]:       <mac address="fa:16:3e:32:8f:90"/>
Nov 10 12:18:41 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:18:41 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:18:41 user nova-compute[74889]:       <target dev="tap19ddbdd8-c5"/>
Nov 10 12:18:41 user nova-compute[74889]:     </interface>
Nov 10 12:18:41 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:18:41 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/983c8d72-90c5-44c9-9480-19c7f5cab3eb/console.log" append="off"/>
Nov 10 12:18:41 user nova-compute[74889]:     </serial>
Nov 10 12:18:41 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:18:41 user nova-compute[74889]:     <video>
Nov 10 12:18:41 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:18:41 user nova-compute[74889]:     </video>
Nov 10 12:18:41 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:18:41 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:18:41 user nova-compute[74889]:     </rng>
Nov 10 12:18:41 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:18:41 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:18:41 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:18:41 user nova-compute[74889]:     </memballoon>
Nov 10 12:18:41 user nova-compute[74889]:   </devices>
Nov 10 12:18:41 user nova-compute[74889]: </domain>
Nov 10 12:18:41 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2105373756',display_name='tempest-TestVolumeBootPattern-server-2105373756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2105373756',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5sI8i7f1ePG/W7UaO+8+gsVMkmIp2O9S2Zp/OA7rnj2vqp7KJJD0civJv0L7iUGqDlP4rsFJ2tgFLkt5XPKycZVXji+0bjZyXuGwJUvRKhSllkY2ECb15wAksxQrkIeg==',key_name='tempest-TestVolumeBootPattern-597466952',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-245rf9jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:18:06Z,user_data=None,user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=983c8d72-90c5-44c9-9480-19c7f5cab3eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:8f:90,bridge_name='br-int',has_traffic_filtering=True,id=19ddbdd8-c5e6-4c82-8c59-0d62929dbef2,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ddbdd8-c5') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG os_vif [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8f:90,bridge_name='br-int',has_traffic_filtering=True,id=19ddbdd8-c5e6-4c82-8c59-0d62929dbef2,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ddbdd8-c5') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ab31670-2212-504f-b3c1-a6fd5f7eeafa', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19ddbdd8-c5, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19ddbdd8-c5, col_values=(('qos', UUID('693052da-0b7e-48f1-88d2-6fdc4f532fc9')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19ddbdd8-c5, col_values=(('external_ids', {'iface-id': '19ddbdd8-c5e6-4c82-8c59-0d62929dbef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:8f:90', 'vm-uuid': '983c8d72-90c5-44c9-9480-19c7f5cab3eb'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:41 user nova-compute[74889]: INFO os_vif [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8f:90,bridge_name='br-int',has_traffic_filtering=True,id=19ddbdd8-c5e6-4c82-8c59-0d62929dbef2,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ddbdd8-c5')
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] No VIF found with MAC fa:16:3e:32:8f:90, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] No waiting events found dispatching network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:41 user nova-compute[74889]: WARNING nova.compute.manager [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received unexpected event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 for instance with vm_state active and task_state rescuing.
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] No waiting events found dispatching network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:41 user nova-compute[74889]: WARNING nova.compute.manager [req-c63f9e89-e232-4eeb-bf01-a05248cee84a req-6686f11d-2c7f-404c-8d9f-6a0c346ce5c3 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received unexpected event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 for instance with vm_state active and task_state rescuing.
Nov 10 12:18:42 user nova-compute[74889]: DEBUG nova.compute.manager [None req-770b0ece-0b3c-4d4b-9ed7-ad856748ee3b tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:18:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-fdb8c315-9ab9-4847-816b-ee455fddcdc8 req-c8c24c24-7310-4c6c-a242-97145222f80f service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received event network-vif-plugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fdb8c315-9ab9-4847-816b-ee455fddcdc8 req-c8c24c24-7310-4c6c-a242-97145222f80f service nova] Acquiring lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fdb8c315-9ab9-4847-816b-ee455fddcdc8 req-c8c24c24-7310-4c6c-a242-97145222f80f service nova] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fdb8c315-9ab9-4847-816b-ee455fddcdc8 req-c8c24c24-7310-4c6c-a242-97145222f80f service nova] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-fdb8c315-9ab9-4847-816b-ee455fddcdc8 req-c8c24c24-7310-4c6c-a242-97145222f80f service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] No waiting events found dispatching network-vif-plugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:43 user nova-compute[74889]: WARNING nova.compute.manager [req-fdb8c315-9ab9-4847-816b-ee455fddcdc8 req-c8c24c24-7310-4c6c-a242-97145222f80f service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received unexpected event network-vif-plugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 for instance with vm_state building and task_state spawning.
Nov 10 12:18:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:18:45 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Instance spawned successfully.
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:18:45 user nova-compute[74889]: INFO nova.compute.manager [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:18:45 user nova-compute[74889]: INFO nova.compute.manager [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Took 40.39 seconds to build instance.
Nov 10 12:18:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-79d3517a-44a7-402e-af6c-cbf7ed62c473 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.518s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-273fae4a-2379-4f44-8d16-4399ff9b76e8 req-cb0c9809-39ba-4488-a2fd-cf871265b6ea service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received event network-vif-plugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-273fae4a-2379-4f44-8d16-4399ff9b76e8 req-cb0c9809-39ba-4488-a2fd-cf871265b6ea service nova] Acquiring lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-273fae4a-2379-4f44-8d16-4399ff9b76e8 req-cb0c9809-39ba-4488-a2fd-cf871265b6ea service nova] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-273fae4a-2379-4f44-8d16-4399ff9b76e8 req-cb0c9809-39ba-4488-a2fd-cf871265b6ea service nova] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-273fae4a-2379-4f44-8d16-4399ff9b76e8 req-cb0c9809-39ba-4488-a2fd-cf871265b6ea service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] No waiting events found dispatching network-vif-plugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:18:45 user nova-compute[74889]: WARNING nova.compute.manager [req-273fae4a-2379-4f44-8d16-4399ff9b76e8 req-cb0c9809-39ba-4488-a2fd-cf871265b6ea service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received unexpected event network-vif-plugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 for instance with vm_state active and task_state None.
Nov 10 12:18:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:18:54 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:18:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:18:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:18:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:18:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:18:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:18:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:18:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating instance_info_cache with network_info: [{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:18:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:18:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:18:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:18:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:01 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:19:01 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=7697MB free_disk=25.007980346679688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7bc18e85-4acb-412e-9186-a37a076cf326 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 983c8d72-90c5-44c9-9480-19c7f5cab3eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:19:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:04 user nova-compute[74889]: INFO nova.compute.manager [None req-281c7a4c-4679-4d07-bac5-bd3df5633595 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Unrescuing
Nov 10 12:19:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-281c7a4c-4679-4d07-bac5-bd3df5633595 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-281c7a4c-4679-4d07-bac5-bd3df5633595 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquired lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG nova.network.neutron [None req-281c7a4c-4679-4d07-bac5-bd3df5633595 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG nova.network.neutron [None req-281c7a4c-4679-4d07-bac5-bd3df5633595 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updating instance_info_cache with network_info: [{"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-281c7a4c-4679-4d07-bac5-bd3df5633595 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Releasing lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-281c7a4c-4679-4d07-bac5-bd3df5633595 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'flavor' on Instance uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-551e8b8e-bc58-48d1-9796-063abae1b007 req-4c743bb4-a369-44ab-b723-c411035e9f08 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-551e8b8e-bc58-48d1-9796-063abae1b007 req-4c743bb4-a369-44ab-b723-c411035e9f08 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-551e8b8e-bc58-48d1-9796-063abae1b007 req-4c743bb4-a369-44ab-b723-c411035e9f08 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-551e8b8e-bc58-48d1-9796-063abae1b007 req-4c743bb4-a369-44ab-b723-c411035e9f08 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:05 user nova-compute[74889]: DEBUG nova.compute.manager [req-551e8b8e-bc58-48d1-9796-063abae1b007 req-4c743bb4-a369-44ab-b723-c411035e9f08 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:19:05 user nova-compute[74889]: WARNING nova.compute.manager [req-551e8b8e-bc58-48d1-9796-063abae1b007 req-4c743bb4-a369-44ab-b723-c411035e9f08 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:19:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Instance destroyed successfully.
Nov 10 12:19:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:19:07 user nova-compute[74889]: WARNING nova.compute.manager [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:19:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:07 user nova-compute[74889]: DEBUG nova.compute.manager [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:19:07 user nova-compute[74889]: WARNING nova.compute.manager [req-f37f22b8-93f8-448b-8dee-7b6beb50855c req-326eafde-425e-4c47-b15b-492f04d57f84 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:19:08 user nova-compute[74889]: DEBUG nova.compute.manager [None req-281c7a4c-4679-4d07-bac5-bd3df5633595 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:19:09 user nova-compute[74889]: DEBUG nova.compute.manager [req-0afcec57-defb-451b-a573-e2365b536b4b req-b1d89516-2e30-4e9f-bdc0-c8d1775fb5b7 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0afcec57-defb-451b-a573-e2365b536b4b req-b1d89516-2e30-4e9f-bdc0-c8d1775fb5b7 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0afcec57-defb-451b-a573-e2365b536b4b req-b1d89516-2e30-4e9f-bdc0-c8d1775fb5b7 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-0afcec57-defb-451b-a573-e2365b536b4b req-b1d89516-2e30-4e9f-bdc0-c8d1775fb5b7 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:09 user nova-compute[74889]: DEBUG nova.compute.manager [req-0afcec57-defb-451b-a573-e2365b536b4b req-b1d89516-2e30-4e9f-bdc0-c8d1775fb5b7 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:19:09 user nova-compute[74889]: WARNING nova.compute.manager [req-0afcec57-defb-451b-a573-e2365b536b4b req-b1d89516-2e30-4e9f-bdc0-c8d1775fb5b7 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state active and task_state None.
Nov 10 12:19:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:19:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:19:12 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:19:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:19:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:19:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:19:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:19:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:19:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:19:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:19:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:19:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:19:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:19:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-8f65fc16-614a-4fd3-b14c-8c8eafd40d44 req-7dbfdf03-0d80-48cb-89c6-0ae4f5b1143f service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received event network-changed-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-8f65fc16-614a-4fd3-b14c-8c8eafd40d44 req-7dbfdf03-0d80-48cb-89c6-0ae4f5b1143f service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Refreshing instance network info cache due to event network-changed-fe4493a2-5797-4a0a-9b7f-58b128da4ecd. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:19:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8f65fc16-614a-4fd3-b14c-8c8eafd40d44 req-7dbfdf03-0d80-48cb-89c6-0ae4f5b1143f service nova] Acquiring lock "refresh_cache-7bc18e85-4acb-412e-9186-a37a076cf326" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:19:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8f65fc16-614a-4fd3-b14c-8c8eafd40d44 req-7dbfdf03-0d80-48cb-89c6-0ae4f5b1143f service nova] Acquired lock "refresh_cache-7bc18e85-4acb-412e-9186-a37a076cf326" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:19:48 user nova-compute[74889]: DEBUG nova.network.neutron [req-8f65fc16-614a-4fd3-b14c-8c8eafd40d44 req-7dbfdf03-0d80-48cb-89c6-0ae4f5b1143f service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Refreshing network info cache for port fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:19:49 user nova-compute[74889]: DEBUG nova.network.neutron [req-8f65fc16-614a-4fd3-b14c-8c8eafd40d44 req-7dbfdf03-0d80-48cb-89c6-0ae4f5b1143f service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Updated VIF entry in instance network info cache for port fe4493a2-5797-4a0a-9b7f-58b128da4ecd. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:19:49 user nova-compute[74889]: DEBUG nova.network.neutron [req-8f65fc16-614a-4fd3-b14c-8c8eafd40d44 req-7dbfdf03-0d80-48cb-89c6-0ae4f5b1143f service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Updating instance_info_cache with network_info: [{"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:19:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8f65fc16-614a-4fd3-b14c-8c8eafd40d44 req-7dbfdf03-0d80-48cb-89c6-0ae4f5b1143f service nova] Releasing lock "refresh_cache-7bc18e85-4acb-412e-9186-a37a076cf326" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:19:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:51 user nova-compute[74889]: INFO nova.compute.manager [None req-8e4bb837-c927-4da3-9ff6-4522da313b5d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Unrescuing
Nov 10 12:19:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8e4bb837-c927-4da3-9ff6-4522da313b5d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8e4bb837-c927-4da3-9ff6-4522da313b5d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquired lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG nova.network.neutron [None req-8e4bb837-c927-4da3-9ff6-4522da313b5d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG nova.network.neutron [None req-8e4bb837-c927-4da3-9ff6-4522da313b5d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating instance_info_cache with network_info: [{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8e4bb837-c927-4da3-9ff6-4522da313b5d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Releasing lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG nova.objects.instance [None req-8e4bb837-c927-4da3-9ff6-4522da313b5d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'flavor' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-59f4498d-1fb3-4eac-8583-26a074830b0a req-ebafa9e9-139d-420a-98c1-60c35f454c0d service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-59f4498d-1fb3-4eac-8583-26a074830b0a req-ebafa9e9-139d-420a-98c1-60c35f454c0d service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-59f4498d-1fb3-4eac-8583-26a074830b0a req-ebafa9e9-139d-420a-98c1-60c35f454c0d service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-59f4498d-1fb3-4eac-8583-26a074830b0a req-ebafa9e9-139d-420a-98c1-60c35f454c0d service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-59f4498d-1fb3-4eac-8583-26a074830b0a req-ebafa9e9-139d-420a-98c1-60c35f454c0d service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:19:51 user nova-compute[74889]: WARNING nova.compute.manager [req-59f4498d-1fb3-4eac-8583-26a074830b0a req-ebafa9e9-139d-420a-98c1-60c35f454c0d service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:19:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:52 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Instance destroyed successfully.
Nov 10 12:19:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.compute.manager [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.compute.manager [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:19:54 user nova-compute[74889]: WARNING nova.compute.manager [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.compute.manager [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-changed-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.compute.manager [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Refreshing instance network info cache due to event network-changed-4c1e4117-f6a1-46d7-9864-d17dacfd1eea. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Acquiring lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Acquired lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.network.neutron [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Refreshing network info cache for port 4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.network.neutron [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updated VIF entry in instance network info cache for port 4c1e4117-f6a1-46d7-9864-d17dacfd1eea. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.network.neutron [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating instance_info_cache with network_info: [{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Releasing lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.compute.manager [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-changed-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.compute.manager [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Refreshing instance network info cache due to event network-changed-4c1e4117-f6a1-46d7-9864-d17dacfd1eea. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Acquiring lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Acquired lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.network.neutron [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Refreshing network info cache for port 4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.network.neutron [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updated VIF entry in instance network info cache for port 4c1e4117-f6a1-46d7-9864-d17dacfd1eea. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.network.neutron [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating instance_info_cache with network_info: [{"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Releasing lock "refresh_cache-903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.compute.manager [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:54 user nova-compute[74889]: DEBUG nova.compute.manager [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:19:54 user nova-compute[74889]: WARNING nova.compute.manager [req-d5bd3f08-b48a-4bc7-b822-215e9f4450cf req-90b1c9e3-fa50-44cf-bde6-20bc633d0f46 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "7bc18e85-4acb-412e-9186-a37a076cf326" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG nova.objects.instance [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lazy-loading 'flavor' on Instance uuid 7bc18e85-4acb-412e-9186-a37a076cf326 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "7bc18e85-4acb-412e-9186-a37a076cf326" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:55 user nova-compute[74889]: INFO nova.compute.manager [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Attaching volume 34b3ea74-164f-44d8-843f-4002aab3c8d1 to /dev/vdb
Nov 10 12:19:55 user nova-compute[74889]: DEBUG os_brick.utils [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e4ba93-7687-483f-bfda-10db2b115325]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4117f2-6a7d-46d2-a287-b87319b11aed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5ca581-9ba4-4e17-8656-743e7ef98c90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6820a23e-6ed9-43ad-852c-3a11c828d64a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:19:55 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:19:55 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[121eabba-040b-43bd-8027-037ab7c8bd37]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG os_brick.utils [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:19:55 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Updating existing volume attachment record: dfafea41-7cd1-4a75-a57f-1f57ded8fd16 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-97dbb8e4-5b18-48eb-8785-f50d575c4cb0 req-a9c06d4b-503c-44a3-8d4c-50926295a880 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-97dbb8e4-5b18-48eb-8785-f50d575c4cb0 req-a9c06d4b-503c-44a3-8d4c-50926295a880 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-97dbb8e4-5b18-48eb-8785-f50d575c4cb0 req-a9c06d4b-503c-44a3-8d4c-50926295a880 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-97dbb8e4-5b18-48eb-8785-f50d575c4cb0 req-a9c06d4b-503c-44a3-8d4c-50926295a880 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-97dbb8e4-5b18-48eb-8785-f50d575c4cb0 req-a9c06d4b-503c-44a3-8d4c-50926295a880 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:19:56 user nova-compute[74889]: WARNING nova.compute.manager [req-97dbb8e4-5b18-48eb-8785-f50d575c4cb0 req-a9c06d4b-503c-44a3-8d4c-50926295a880 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:19:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-8e4bb837-c927-4da3-9ff6-4522da313b5d tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updating instance_info_cache with network_info: [{"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:19:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:57 user nova-compute[74889]: INFO nova.compute.manager [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Terminating instance
Nov 10 12:19:57 user nova-compute[74889]: DEBUG nova.compute.manager [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:19:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received event network-changed-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Refreshing instance network info cache due to event network-changed-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] Acquiring lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] Acquired lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.network.neutron [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Refreshing network info cache for port 19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-44d783ad-fd81-4efc-81d7-03821222c937 req-61ad47a2-1fcc-41ac-9e36-4958b5848ea7 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received event network-vif-unplugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-44d783ad-fd81-4efc-81d7-03821222c937 req-61ad47a2-1fcc-41ac-9e36-4958b5848ea7 service nova] Acquiring lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-44d783ad-fd81-4efc-81d7-03821222c937 req-61ad47a2-1fcc-41ac-9e36-4958b5848ea7 service nova] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-44d783ad-fd81-4efc-81d7-03821222c937 req-61ad47a2-1fcc-41ac-9e36-4958b5848ea7 service nova] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-44d783ad-fd81-4efc-81d7-03821222c937 req-61ad47a2-1fcc-41ac-9e36-4958b5848ea7 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] No waiting events found dispatching network-vif-unplugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-44d783ad-fd81-4efc-81d7-03821222c937 req-61ad47a2-1fcc-41ac-9e36-4958b5848ea7 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received event network-vif-unplugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.network.neutron [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Updated VIF entry in instance network info cache for port 19ddbdd8-c5e6-4c82-8c59-0d62929dbef2. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.network.neutron [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Updating instance_info_cache with network_info: [{"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] Releasing lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received event network-changed-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Refreshing instance network info cache due to event network-changed-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] Acquiring lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] Acquired lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.network.neutron [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Refreshing network info cache for port 19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:19:58 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Instance destroyed successfully.
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.objects.instance [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lazy-loading 'resources' on Instance uuid 983c8d72-90c5-44c9-9480-19c7f5cab3eb {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2105373756',display_name='tempest-TestVolumeBootPattern-server-2105373756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2105373756',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5sI8i7f1ePG/W7UaO+8+gsVMkmIp2O9S2Zp/OA7rnj2vqp7KJJD0civJv0L7iUGqDlP4rsFJ2tgFLkt5XPKycZVXji+0bjZyXuGwJUvRKhSllkY2ECb15wAksxQrkIeg==',key_name='tempest-TestVolumeBootPattern-597466952',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:18:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-245rf9jl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:18:45Z,user_data=None,user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=983c8d72-90c5-44c9-9480-19c7f5cab3eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:8f:90,bridge_name='br-int',has_traffic_filtering=True,id=19ddbdd8-c5e6-4c82-8c59-0d62929dbef2,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ddbdd8-c5') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_vif [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8f:90,bridge_name='br-int',has_traffic_filtering=True,id=19ddbdd8-c5e6-4c82-8c59-0d62929dbef2,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ddbdd8-c5') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19ddbdd8-c5, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=693052da-0b7e-48f1-88d2-6fdc4f532fc9) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:19:58 user nova-compute[74889]: INFO os_vif [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:8f:90,bridge_name='br-int',has_traffic_filtering=True,id=19ddbdd8-c5e6-4c82-8c59-0d62929dbef2,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19ddbdd8-c5')
Nov 10 12:19:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XRBCGoiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:19:58 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a17137b-7412-47d3-9037-28d5ae0abdbf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:19:58 user nova-compute[74889]: No targets found.
Nov 10 12:19:58 user nova-compute[74889]: iSNS:
Nov 10 12:19:58 user nova-compute[74889]: No targets found.
Nov 10 12:19:58 user nova-compute[74889]: STATIC:
Nov 10 12:19:58 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b
Nov 10 12:19:58 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:19:58 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:19:58 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4
Nov 10 12:19:58 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:19:58 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:19:58 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:19:58 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:19:58 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:19:58 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c
Nov 10 12:19:58 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:19:58 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:19:58 user nova-compute[74889]: FIRMWARE:
Nov 10 12:19:58 user nova-compute[74889]: No targets found.
Nov 10 12:19:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:19:58 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:19:58 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef2b7a5-59fc-414a-989c-59d813ca8ab8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7050e26-aa10-41fb-86bc-12429db638a3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:19:58 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:19:58 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:19:58 user nova-compute[74889]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 (non-flash)
Nov 10 12:19:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:19:58 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:19:58 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:19:58 user nova-compute[74889]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 (non-flash)
Nov 10 12:19:58 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa39823e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4'): ({'sde'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:19:58 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Removing single pathed devices sde {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1334cd9b-2ffe-4d0a-bc3f-2d7622029722]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc7e8a9-bb8d-4f1c-941f-ad9ff817c8c5]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flushing IO for device /dev/sde {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b792960-498b-43ca-9daa-459200fc5590]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.072s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[233cf45a-b9c6-418f-b0bc-dd03ac25fe9b]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[197025ac-10a0-4980-8edb-725b1fbc9439]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec59f09-9ba3-4f9c-a286-a07c5cd2d008]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4, portal: 172.16.0.220,3260]
Nov 10 12:19:59 user nova-compute[74889]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4, portal: 172.16.0.220,3260] successful.
Nov 10 12:19:59 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96c38a1d-6e36-4838-a5f9-0d15e9ee66e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afd5abe-fb4c-4910-aa9a-cd9f9280663a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== disconnect_volume: return (428ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:19:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Deleting instance files /opt/stack/data/nova/instances/983c8d72-90c5-44c9-9480-19c7f5cab3eb_del
Nov 10 12:19:59 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Deletion of /opt/stack/data/nova/instances/983c8d72-90c5-44c9-9480-19c7f5cab3eb_del complete
Nov 10 12:19:59 user nova-compute[74889]: DEBUG nova.network.neutron [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Updated VIF entry in instance network info cache for port 19ddbdd8-c5e6-4c82-8c59-0d62929dbef2. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG nova.network.neutron [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Updating instance_info_cache with network_info: [{"id": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "address": "fa:16:3e:32:8f:90", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19ddbdd8-c5", "ovs_interfaceid": "19ddbdd8-c5e6-4c82-8c59-0d62929dbef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:19:59 user nova-compute[74889]: INFO nova.compute.manager [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Took 1.46 seconds to destroy the instance on the hypervisor.
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9093e1bd-67c9-4448-94e0-dd25343eaf8b req-20ed3f28-4fa3-4b04-a7ac-2ef888f93b8b service nova] Releasing lock "refresh_cache-983c8d72-90c5-44c9-9480-19c7f5cab3eb" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:19:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:20:00 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Took 0.60 seconds to deallocate network for instance.
Nov 10 12:20:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-8fba93d9-3e38-4917-9a06-38c5a3e23ce1 req-85269aff-f8f5-4cfe-a1c4-a7d14bc642df service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received event network-vif-deleted-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:20:00 user nova-compute[74889]: INFO nova.compute.manager [req-8fba93d9-3e38-4917-9a06-38c5a3e23ce1 req-85269aff-f8f5-4cfe-a1c4-a7d14bc642df service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Neutron deleted interface 19ddbdd8-c5e6-4c82-8c59-0d62929dbef2; detaching it from the instance and deleting it from the info cache
Nov 10 12:20:00 user nova-compute[74889]: DEBUG nova.network.neutron [req-8fba93d9-3e38-4917-9a06-38c5a3e23ce1 req-85269aff-f8f5-4cfe-a1c4-a7d14bc642df service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-8fba93d9-3e38-4917-9a06-38c5a3e23ce1 req-85269aff-f8f5-4cfe-a1c4-a7d14bc642df service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Detach interface failed, port_id=19ddbdd8-c5e6-4c82-8c59-0d62929dbef2, reason: Instance 983c8d72-90c5-44c9-9480-19c7f5cab3eb could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-51553e92-1caf-493d-b57d-cda322e47f98 req-a97a443b-b617-47b4-8432-efbc0c73edd3 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received event network-vif-plugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-51553e92-1caf-493d-b57d-cda322e47f98 req-a97a443b-b617-47b4-8432-efbc0c73edd3 service nova] Acquiring lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-51553e92-1caf-493d-b57d-cda322e47f98 req-a97a443b-b617-47b4-8432-efbc0c73edd3 service nova] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-51553e92-1caf-493d-b57d-cda322e47f98 req-a97a443b-b617-47b4-8432-efbc0c73edd3 service nova] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-51553e92-1caf-493d-b57d-cda322e47f98 req-a97a443b-b617-47b4-8432-efbc0c73edd3 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] No waiting events found dispatching network-vif-plugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:20:00 user nova-compute[74889]: WARNING nova.compute.manager [req-51553e92-1caf-493d-b57d-cda322e47f98 req-a97a443b-b617-47b4-8432-efbc0c73edd3 service nova] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Received unexpected event network-vif-plugged-19ddbdd8-c5e6-4c82-8c59-0d62929dbef2 for instance with vm_state active and task_state deleting.
Nov 10 12:20:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:00 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:20:00 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:20:00 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8099MB free_disk=25.0074462890625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7bc18e85-4acb-412e-9186-a37a076cf326 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 983c8d72-90c5-44c9-9480-19c7f5cab3eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:20:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:02 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:20:02 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:20:02 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:20:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:04 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:20:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:20:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:20:12 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:20:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:18 user nova-compute[74889]: INFO nova.compute.manager [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 983c8d72-90c5-44c9-9480-19c7f5cab3eb] Took 18.83 seconds to detach 1 volumes for instance.
Nov 10 12:20:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:19 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:20:19 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:20:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:19 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Deleted allocations for instance 983c8d72-90c5-44c9-9480-19c7f5cab3eb
Nov 10 12:20:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2ca58c31-7680-4f30-8d34-6ce68cdc3352 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "983c8d72-90c5-44c9-9480-19c7f5cab3eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 21.414s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWHDMfNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:20:21 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:20:21 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:20:21 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0be95b-a7f5-4c51-8a5d-3481f9b672b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:20:21 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[75959e0e-74f8-4d05-b59f-07c2a11c5d95]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1] added
Nov 10 12:20:21 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8ab156-5446-4067-88ea-6008a099e17f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c60cd1f-e2fa-4119-8aa9-f1064819842e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWHDMfNA {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWHDMfNA" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbb148a-5f0c-4859-a8c8-95b6124f149f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWHDMfNA'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[44613cb9-76d7-4f0a-9fd2-d1a4acb17a5c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa0e235-c908-4d42-9264-b30da52d0d12]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:20:21 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:20:21 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:20:21 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:20:21 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:20:21 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:20:21 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[819fb22d-2144-4e36-8b9b-249fa5b6f936]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1, portal: 172.16.0.220,3260]
Nov 10 12:20:21 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1, portal: 172.16.0.220,3260] successful.
Nov 10 12:20:21 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebba31f0-7022-4163-af0b-44c78caca0ef]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96e95a5-2c02-4c55-988b-7cd0fcc3d744]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:20:21 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:20:21 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:20:21 user nova-compute[74889]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 (non-flash)
Nov 10 12:20:21 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:20:21 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:20:21 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:20:21 user nova-compute[74889]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 (non-flash)
Nov 10 12:20:21 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c17850f-a225-43cf-aaaa-818986b93032]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:20:21 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWHDMfNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:20:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:20:22 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26330353766376537', 'path': '/dev/sde'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:20:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26330353766376537', 'path': '/dev/sde'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:20:22 user nova-compute[74889]: DEBUG nova.objects.instance [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lazy-loading 'flavor' on Instance uuid 7bc18e85-4acb-412e-9186-a37a076cf326 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:20:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:20:22 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:20:22 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:20:22 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:20:22 user nova-compute[74889]:   <serial>34b3ea74-164f-44d8-843f-4002aab3c8d1</serial>
Nov 10 12:20:22 user nova-compute[74889]: </disk>
Nov 10 12:20:22 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:20:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:20:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:20:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] No VIF found with MAC fa:16:3e:f3:75:6c, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:20:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8bb64841-549d-41e1-8ba5-196f8e5d1ced tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.787s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:24 user nova-compute[74889]: INFO nova.compute.manager [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Detaching volume 3805de67-f621-4513-b3fb-f80c8f938f9b
Nov 10 12:20:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "7bc18e85-4acb-412e-9186-a37a076cf326" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:24 user nova-compute[74889]: INFO nova.compute.manager [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Detaching volume 34b3ea74-164f-44d8-843f-4002aab3c8d1
Nov 10 12:20:24 user nova-compute[74889]: INFO nova.virt.block_device [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Attempting to driver detach volume 3805de67-f621-4513-b3fb-f80c8f938f9b from mountpoint /dev/vdb
Nov 10 12:20:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Attempting to detach device vdb from instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:20:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:20:24 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:20:24 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:20:24 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:20:24 user nova-compute[74889]:   <serial>3805de67-f621-4513-b3fb-f80c8f938f9b</serial>
Nov 10 12:20:24 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:20:24 user nova-compute[74889]: </disk>
Nov 10 12:20:24 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:20:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Successfully detached device vdb from instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 from the persistent domain config.
Nov 10 12:20:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:20:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:20:24 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:20:24 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:20:24 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:20:24 user nova-compute[74889]:   <serial>3805de67-f621-4513-b3fb-f80c8f938f9b</serial>
Nov 10 12:20:24 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:20:24 user nova-compute[74889]: </disk>
Nov 10 12:20:24 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:20:24 user nova-compute[74889]: INFO nova.virt.block_device [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Attempting to driver detach volume 34b3ea74-164f-44d8-843f-4002aab3c8d1 from mountpoint /dev/vdb
Nov 10 12:20:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Attempting to detach device vdb from instance 7bc18e85-4acb-412e-9186-a37a076cf326 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:20:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:20:24 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:20:24 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:20:24 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:20:24 user nova-compute[74889]:   <serial>34b3ea74-164f-44d8-843f-4002aab3c8d1</serial>
Nov 10 12:20:24 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:20:24 user nova-compute[74889]: </disk>
Nov 10 12:20:24 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:20:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Successfully detached device vdb from instance 7bc18e85-4acb-412e-9186-a37a076cf326 from the persistent domain config.
Nov 10 12:20:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7bc18e85-4acb-412e-9186-a37a076cf326 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:20:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:20:24 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:20:24 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:20:24 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:20:24 user nova-compute[74889]:   <serial>34b3ea74-164f-44d8-843f-4002aab3c8d1</serial>
Nov 10 12:20:24 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:20:24 user nova-compute[74889]: </disk>
Nov 10 12:20:24 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:20:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:20:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7bc18e85-4acb-412e-9186-a37a076cf326 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:20:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 is timed out.
Nov 10 12:20:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Successfully detached device vdb from instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 from the live domain config.
Nov 10 12:20:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:20:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DUdOBolP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:20:44 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:20:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:20:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:20:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1611168b-9a55-4645-b8c4-350485b39167]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:20:45 user nova-compute[74889]: No targets found.
Nov 10 12:20:45 user nova-compute[74889]: iSNS:
Nov 10 12:20:45 user nova-compute[74889]: No targets found.
Nov 10 12:20:45 user nova-compute[74889]: STATIC:
Nov 10 12:20:45 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1
Nov 10 12:20:45 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:20:45 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:20:45 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b
Nov 10 12:20:45 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:20:45 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:20:45 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:20:45 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:20:45 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:20:45 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c
Nov 10 12:20:45 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:20:45 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:20:45 user nova-compute[74889]: FIRMWARE:
Nov 10 12:20:45 user nova-compute[74889]: No targets found.
Nov 10 12:20:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:20:45 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:20:45 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c683630e-1338-488c-8734-4c0d385ffe11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[39be0af5-f644-4735-b549-264e9f07a2e1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:20:45 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:20:45 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:20:45 user nova-compute[74889]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 (non-flash)
Nov 10 12:20:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:20:45 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:20:45 user nova-compute[74889]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b (non-flash)
Nov 10 12:20:45 user nova-compute[74889]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 (non-flash)
Nov 10 12:20:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398206d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d0aaf-6038-4672-8398-7c94055f61b7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2974381e-3e5d-423e-a765-a78d879f388a]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d13d7e-3416-4c4d-bcb7-a8dc6e2482b3]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4503c815-9366-4010-a9f0-622b0bef5dbf]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f85861-c156-4332-889b-54c4fc1836aa]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[45347a95-7673-4f47-aa5a-1a7f523762d1]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b, portal: 172.16.0.220,3260]
Nov 10 12:20:45 user nova-compute[74889]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b, portal: 172.16.0.220,3260] successful.
Nov 10 12:20:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7bc18e85-4acb-412e-9186-a37a076cf326 is timed out.
Nov 10 12:20:45 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Successfully detached device vdb from instance 7bc18e85-4acb-412e-9186-a37a076cf326 from the live domain config.
Nov 10 12:20:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWHDMfNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:20:45 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3805de67-f621-4513-b3fb-f80c8f938f9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f7fe7-dce2-47d4-ab37-e688ce132d7c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] <== disconnect_volume: return (302ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.017s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af9849d-3b26-46aa-86c4-760d733d7153]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:20:45 user nova-compute[74889]: No targets found.
Nov 10 12:20:45 user nova-compute[74889]: iSNS:
Nov 10 12:20:45 user nova-compute[74889]: No targets found.
Nov 10 12:20:45 user nova-compute[74889]: STATIC:
Nov 10 12:20:45 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1
Nov 10 12:20:45 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:20:45 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:20:45 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:20:45 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:20:45 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:20:45 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c
Nov 10 12:20:45 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:20:45 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:20:45 user nova-compute[74889]: FIRMWARE:
Nov 10 12:20:45 user nova-compute[74889]: No targets found.
Nov 10 12:20:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:20:45 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:20:45 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ede02a-48ae-49ba-812b-28829e10b927]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8856f38-0997-415c-9cc3-ed6bbedeef0d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:20:45 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:20:45 user nova-compute[74889]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 (non-flash)
Nov 10 12:20:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:20:45 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:20:45 user nova-compute[74889]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 (non-flash)
Nov 10 12:20:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398289090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1'): ({'sde'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Removing single pathed devices sde {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[157f6afa-a247-435f-bc95-e291b31e0d0e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5420dc-8dc1-4a29-bfee-35175943dbe9]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Flushing IO for device /dev/sde {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c35393-667e-4244-93e3-1c21e7f98c27]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[018297ce-2054-4254-a839-04b0318bdbf4]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0b5d41-baa8-4a1c-8e49-181e73effa8e]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[692bf4de-acaf-4d62-9c9e-65afecdf0279]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1, portal: 172.16.0.220,3260]
Nov 10 12:20:45 user nova-compute[74889]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1, portal: 172.16.0.220,3260] successful.
Nov 10 12:20:45 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34b3ea74-164f-44d8-843f-4002aab3c8d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3cd529-2e33-42f5-8da3-7a9578fd8276]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] <== disconnect_volume: return (310ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:20:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:20:46 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'flavor' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:20:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9802a615-c594-4ee2-a338-fab301346693 tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.800s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:46 user nova-compute[74889]: DEBUG nova.objects.instance [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lazy-loading 'flavor' on Instance uuid 7bc18e85-4acb-412e-9186-a37a076cf326 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:20:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c5d189eb-998b-4e19-8a2a-bf27011d68d7 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.091s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:20:56 user nova-compute[74889]: INFO nova.compute.claims [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Claim successful on node user
Nov 10 12:20:56 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:20:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:20:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG nova.compute.manager [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:20:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Creating image(s)
Nov 10 12:20:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "/opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "/opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "/opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:56 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG nova.policy [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c2a48cfc9e04a2dbd2ad51b70c8b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757eef88e9c04404a1ddedfa23b6031d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk 1073741824" returned: 0 in 0.047s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.166s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG nova.network.neutron [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Successfully created port: 63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Cannot resize image /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Ensure instance console log exists: /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.neutron [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Successfully updated port: 63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "refresh_cache-990a099a-7893-4428-9de1-8dc217bf2fc0" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquired lock "refresh_cache-990a099a-7893-4428-9de1-8dc217bf2fc0" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.neutron [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-ef07edc0-5cd4-409b-ad10-61c0ec5fe255 req-f8c9edb6-9b1e-431c-b037-835da5d454d7 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-changed-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-ef07edc0-5cd4-409b-ad10-61c0ec5fe255 req-f8c9edb6-9b1e-431c-b037-835da5d454d7 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Refreshing instance network info cache due to event network-changed-63459792-78b7-4048-8711-69fb4afaf388. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ef07edc0-5cd4-409b-ad10-61c0ec5fe255 req-f8c9edb6-9b1e-431c-b037-835da5d454d7 service nova] Acquiring lock "refresh_cache-990a099a-7893-4428-9de1-8dc217bf2fc0" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.neutron [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.neutron [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Updating instance_info_cache with network_info: [{"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Releasing lock "refresh_cache-990a099a-7893-4428-9de1-8dc217bf2fc0" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Instance network_info: |[{"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ef07edc0-5cd4-409b-ad10-61c0ec5fe255 req-f8c9edb6-9b1e-431c-b037-835da5d454d7 service nova] Acquired lock "refresh_cache-990a099a-7893-4428-9de1-8dc217bf2fc0" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.neutron [req-ef07edc0-5cd4-409b-ad10-61c0ec5fe255 req-f8c9edb6-9b1e-431c-b037-835da5d454d7 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Refreshing network info cache for port 63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Start _get_guest_xml network_info=[{"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updating instance_info_cache with network_info: [{"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:20:58 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:20:58 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:20:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1358922037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1358922037',id=45,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-o0awf097',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:20:57Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=990a099a-7893-4428-9de1-8dc217bf2fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:76:40,bridge_name='br-int',has_traffic_filtering=True,id=63459792-78b7-4048-8711-69fb4afaf388,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63459792-78') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.objects.instance [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'pci_devices' on Instance uuid 990a099a-7893-4428-9de1-8dc217bf2fc0 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:20:58 user nova-compute[74889]:   <uuid>990a099a-7893-4428-9de1-8dc217bf2fc0</uuid>
Nov 10 12:20:58 user nova-compute[74889]:   <name>instance-0000002d</name>
Nov 10 12:20:58 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:20:58 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:20:58 user nova-compute[74889]:   <metadata>
Nov 10 12:20:58 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:20:58 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:20:58 user nova-compute[74889]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1358922037</nova:name>
Nov 10 12:20:58 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:20:58</nova:creationTime>
Nov 10 12:20:58 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:20:58 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:20:58 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:20:58 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:20:58 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:20:58 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:20:58 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:20:58 user nova-compute[74889]:       <nova:owner>
Nov 10 12:20:58 user nova-compute[74889]:         <nova:user uuid="4c2a48cfc9e04a2dbd2ad51b70c8b114">tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member</nova:user>
Nov 10 12:20:58 user nova-compute[74889]:         <nova:project uuid="757eef88e9c04404a1ddedfa23b6031d">tempest-ServerBootFromVolumeStableRescueTest-1484079705</nova:project>
Nov 10 12:20:58 user nova-compute[74889]:       </nova:owner>
Nov 10 12:20:58 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:20:58 user nova-compute[74889]:       <nova:ports>
Nov 10 12:20:58 user nova-compute[74889]:         <nova:port uuid="63459792-78b7-4048-8711-69fb4afaf388">
Nov 10 12:20:58 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 12:20:58 user nova-compute[74889]:         </nova:port>
Nov 10 12:20:58 user nova-compute[74889]:       </nova:ports>
Nov 10 12:20:58 user nova-compute[74889]:     </nova:instance>
Nov 10 12:20:58 user nova-compute[74889]:   </metadata>
Nov 10 12:20:58 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:20:58 user nova-compute[74889]:     <system>
Nov 10 12:20:58 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:20:58 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:20:58 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:20:58 user nova-compute[74889]:       <entry name="serial">990a099a-7893-4428-9de1-8dc217bf2fc0</entry>
Nov 10 12:20:58 user nova-compute[74889]:       <entry name="uuid">990a099a-7893-4428-9de1-8dc217bf2fc0</entry>
Nov 10 12:20:58 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:20:58 user nova-compute[74889]:     </system>
Nov 10 12:20:58 user nova-compute[74889]:   </sysinfo>
Nov 10 12:20:58 user nova-compute[74889]:   <os>
Nov 10 12:20:58 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:20:58 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:20:58 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:20:58 user nova-compute[74889]:   </os>
Nov 10 12:20:58 user nova-compute[74889]:   <features>
Nov 10 12:20:58 user nova-compute[74889]:     <acpi/>
Nov 10 12:20:58 user nova-compute[74889]:     <apic/>
Nov 10 12:20:58 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:20:58 user nova-compute[74889]:   </features>
Nov 10 12:20:58 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:20:58 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:20:58 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:20:58 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:20:58 user nova-compute[74889]:   </clock>
Nov 10 12:20:58 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:20:58 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:20:58 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:20:58 user nova-compute[74889]:   </cpu>
Nov 10 12:20:58 user nova-compute[74889]:   <devices>
Nov 10 12:20:58 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:20:58 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:20:58 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk"/>
Nov 10 12:20:58 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:20:58 user nova-compute[74889]:     </disk>
Nov 10 12:20:58 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:20:58 user nova-compute[74889]:       <mac address="fa:16:3e:b5:76:40"/>
Nov 10 12:20:58 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:20:58 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:20:58 user nova-compute[74889]:       <target dev="tap63459792-78"/>
Nov 10 12:20:58 user nova-compute[74889]:     </interface>
Nov 10 12:20:58 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:20:58 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/console.log" append="off"/>
Nov 10 12:20:58 user nova-compute[74889]:     </serial>
Nov 10 12:20:58 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:20:58 user nova-compute[74889]:     <video>
Nov 10 12:20:58 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:20:58 user nova-compute[74889]:     </video>
Nov 10 12:20:58 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:20:58 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:20:58 user nova-compute[74889]:     </rng>
Nov 10 12:20:58 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:20:58 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:20:58 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:20:58 user nova-compute[74889]:     </memballoon>
Nov 10 12:20:58 user nova-compute[74889]:   </devices>
Nov 10 12:20:58 user nova-compute[74889]: </domain>
Nov 10 12:20:58 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1358922037',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1358922037',id=45,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-o0awf097',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:20:57Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=990a099a-7893-4428-9de1-8dc217bf2fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:76:40,bridge_name='br-int',has_traffic_filtering=True,id=63459792-78b7-4048-8711-69fb4afaf388,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63459792-78') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG os_vif [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:76:40,bridge_name='br-int',has_traffic_filtering=True,id=63459792-78b7-4048-8711-69fb4afaf388,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63459792-78') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:20:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a956c19-17db-5e43-860f-94562dc50f80', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63459792-78, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63459792-78, col_values=(('qos', UUID('6a50017c-b5d4-4d67-a980-8532386328e6')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63459792-78, col_values=(('external_ids', {'iface-id': '63459792-78b7-4048-8711-69fb4afaf388', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:76:40', 'vm-uuid': '990a099a-7893-4428-9de1-8dc217bf2fc0'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:20:59 user nova-compute[74889]: INFO os_vif [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:76:40,bridge_name='br-int',has_traffic_filtering=True,id=63459792-78b7-4048-8711-69fb4afaf388,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63459792-78')
Nov 10 12:20:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No VIF found with MAC fa:16:3e:b5:76:40, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG nova.network.neutron [req-ef07edc0-5cd4-409b-ad10-61c0ec5fe255 req-f8c9edb6-9b1e-431c-b037-835da5d454d7 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Updated VIF entry in instance network info cache for port 63459792-78b7-4048-8711-69fb4afaf388. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG nova.network.neutron [req-ef07edc0-5cd4-409b-ad10-61c0ec5fe255 req-f8c9edb6-9b1e-431c-b037-835da5d454d7 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Updating instance_info_cache with network_info: [{"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ef07edc0-5cd4-409b-ad10-61c0ec5fe255 req-f8c9edb6-9b1e-431c-b037-835da5d454d7 service nova] Releasing lock "refresh_cache-990a099a-7893-4428-9de1-8dc217bf2fc0" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:20:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-1cc9e63d-f892-4348-a621-f637434790c3 req-8ff7196d-acb8-45d9-b4fd-c1db7cb2bffc service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1cc9e63d-f892-4348-a621-f637434790c3 req-8ff7196d-acb8-45d9-b4fd-c1db7cb2bffc service nova] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1cc9e63d-f892-4348-a621-f637434790c3 req-8ff7196d-acb8-45d9-b4fd-c1db7cb2bffc service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1cc9e63d-f892-4348-a621-f637434790c3 req-8ff7196d-acb8-45d9-b4fd-c1db7cb2bffc service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG nova.compute.manager [req-1cc9e63d-f892-4348-a621-f637434790c3 req-8ff7196d-acb8-45d9-b4fd-c1db7cb2bffc service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] No waiting events found dispatching network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:00 user nova-compute[74889]: WARNING nova.compute.manager [req-1cc9e63d-f892-4348-a621-f637434790c3 req-8ff7196d-acb8-45d9-b4fd-c1db7cb2bffc service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received unexpected event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 for instance with vm_state building and task_state spawning.
Nov 10 12:21:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:02 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:21:02 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8293MB free_disk=24.996902465820312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7bc18e85-4acb-412e-9186-a37a076cf326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-b4244296-56c0-46e4-9228-25e25598bc45 req-f26a4e27-fe43-4757-ac8d-f4a3c4e2cf35 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b4244296-56c0-46e4-9228-25e25598bc45 req-f26a4e27-fe43-4757-ac8d-f4a3c4e2cf35 service nova] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b4244296-56c0-46e4-9228-25e25598bc45 req-f26a4e27-fe43-4757-ac8d-f4a3c4e2cf35 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b4244296-56c0-46e4-9228-25e25598bc45 req-f26a4e27-fe43-4757-ac8d-f4a3c4e2cf35 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.manager [req-b4244296-56c0-46e4-9228-25e25598bc45 req-f26a4e27-fe43-4757-ac8d-f4a3c4e2cf35 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] No waiting events found dispatching network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:02 user nova-compute[74889]: WARNING nova.compute.manager [req-b4244296-56c0-46e4-9228-25e25598bc45 req-f26a4e27-fe43-4757-ac8d-f4a3c4e2cf35 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received unexpected event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 for instance with vm_state building and task_state spawning.
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.manager [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:21:02 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Instance spawned successfully.
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:21:02 user nova-compute[74889]: INFO nova.compute.manager [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.manager [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:21:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:03 user nova-compute[74889]: INFO nova.compute.manager [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Took 6.76 seconds to build instance.
Nov 10 12:21:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-07e33d6d-4a6b-4943-89f1-242bad05c44b tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.891s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:03 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:21:03 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:21:03 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:21:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:21:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:21:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-76b37cb1-4e53-47d8-bb9f-52ed9461999f req-94ab2fcc-9cac-4c48-b1f2-efac57a80bee service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received event network-changed-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-76b37cb1-4e53-47d8-bb9f-52ed9461999f req-94ab2fcc-9cac-4c48-b1f2-efac57a80bee service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Refreshing instance network info cache due to event network-changed-be7a9750-0602-490c-855b-5f6015d79ebd. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-76b37cb1-4e53-47d8-bb9f-52ed9461999f req-94ab2fcc-9cac-4c48-b1f2-efac57a80bee service nova] Acquiring lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-76b37cb1-4e53-47d8-bb9f-52ed9461999f req-94ab2fcc-9cac-4c48-b1f2-efac57a80bee service nova] Acquired lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.network.neutron [req-76b37cb1-4e53-47d8-bb9f-52ed9461999f req-94ab2fcc-9cac-4c48-b1f2-efac57a80bee service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Refreshing network info cache for port be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:12 user nova-compute[74889]: INFO nova.compute.manager [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Terminating instance
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.compute.manager [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-6a0e1260-155b-40fa-95c0-62b91fcbcfe7 req-18646d71-1dc7-4624-89cf-80249f83a3f8 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received event network-vif-unplugged-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6a0e1260-155b-40fa-95c0-62b91fcbcfe7 req-18646d71-1dc7-4624-89cf-80249f83a3f8 service nova] Acquiring lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6a0e1260-155b-40fa-95c0-62b91fcbcfe7 req-18646d71-1dc7-4624-89cf-80249f83a3f8 service nova] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6a0e1260-155b-40fa-95c0-62b91fcbcfe7 req-18646d71-1dc7-4624-89cf-80249f83a3f8 service nova] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-6a0e1260-155b-40fa-95c0-62b91fcbcfe7 req-18646d71-1dc7-4624-89cf-80249f83a3f8 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] No waiting events found dispatching network-vif-unplugged-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-6a0e1260-155b-40fa-95c0-62b91fcbcfe7 req-18646d71-1dc7-4624-89cf-80249f83a3f8 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received event network-vif-unplugged-be7a9750-0602-490c-855b-5f6015d79ebd for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.network.neutron [req-76b37cb1-4e53-47d8-bb9f-52ed9461999f req-94ab2fcc-9cac-4c48-b1f2-efac57a80bee service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updated VIF entry in instance network info cache for port be7a9750-0602-490c-855b-5f6015d79ebd. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.network.neutron [req-76b37cb1-4e53-47d8-bb9f-52ed9461999f req-94ab2fcc-9cac-4c48-b1f2-efac57a80bee service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updating instance_info_cache with network_info: [{"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-76b37cb1-4e53-47d8-bb9f-52ed9461999f req-94ab2fcc-9cac-4c48-b1f2-efac57a80bee service nova] Releasing lock "refresh_cache-215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:21:12 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Instance destroyed successfully.
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.objects.instance [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lazy-loading 'resources' on Instance uuid 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:15:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1835683287',display_name='tempest-TestVolumeBootPattern-server-1835683287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1835683287',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5sI8i7f1ePG/W7UaO+8+gsVMkmIp2O9S2Zp/OA7rnj2vqp7KJJD0civJv0L7iUGqDlP4rsFJ2tgFLkt5XPKycZVXji+0bjZyXuGwJUvRKhSllkY2ECb15wAksxQrkIeg==',key_name='tempest-TestVolumeBootPattern-597466952',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:16:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e703b195816426d9054c28fa6cd15cc',ramdisk_id='',reservation_id='r-zkivbekj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1577456798',owner_user_name='tempest-TestVolumeBootPattern-1577456798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:16:09Z,user_data=None,user_id='b53b32c4dd094fb4a4b0618dc619b21f',uuid=215c5f9c-13dd-45ba-a4d2-30fddb6e0fff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converting VIF {"id": "be7a9750-0602-490c-855b-5f6015d79ebd", "address": "fa:16:3e:16:02:38", "network": {"id": "99b8cea5-00b6-4357-be88-cdb024fc1d19", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1693630014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e703b195816426d9054c28fa6cd15cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe7a9750-06", "ovs_interfaceid": "be7a9750-0602-490c-855b-5f6015d79ebd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:02:38,bridge_name='br-int',has_traffic_filtering=True,id=be7a9750-0602-490c-855b-5f6015d79ebd,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7a9750-06') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG os_vif [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:02:38,bridge_name='br-int',has_traffic_filtering=True,id=be7a9750-0602-490c-855b-5f6015d79ebd,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7a9750-06') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe7a9750-06, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64d60116-c9c6-4778-b51b-14e574aad745) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:21:12 user nova-compute[74889]: INFO os_vif [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:02:38,bridge_name='br-int',has_traffic_filtering=True,id=be7a9750-0602-490c-855b-5f6015d79ebd,network=Network(99b8cea5-00b6-4357-be88-cdb024fc1d19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe7a9750-06')
Nov 10 12:21:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjutlEDq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:21:12 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:21:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6ff0fc-d15b-4aea-9717-dcc6dd4ea95d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:21:12 user nova-compute[74889]: No targets found.
Nov 10 12:21:12 user nova-compute[74889]: iSNS:
Nov 10 12:21:12 user nova-compute[74889]: No targets found.
Nov 10 12:21:12 user nova-compute[74889]: STATIC:
Nov 10 12:21:12 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:21:12 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:21:12 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:21:12 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c
Nov 10 12:21:12 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:21:12 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:21:12 user nova-compute[74889]: FIRMWARE:
Nov 10 12:21:12 user nova-compute[74889]: No targets found.
Nov 10 12:21:12 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:21:12 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:21:12 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cee3843-c041-446d-b25c-ec0355a1b6a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:21:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5351699-6e18-4a30-b55d-5db10cb86e1b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:21:13 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:21:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:21:13 user nova-compute[74889]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c (non-flash)
Nov 10 12:21:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3881a7d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c'): ({'sdc'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Removing single pathed devices sdc {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5861ddc3-3d79-4773-8c88-10a9b6fe9011]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e066d8-05e1-4cc5-80a3-e126500e9d94]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Flushing IO for device /dev/sdc {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[708f178d-8d67-422c-8fb1-4b27d2c433b0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5b7bbd-4d98-4cd6-8684-83968582ca0d]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8956d74-5fd5-4583-8bef-3ce4dae113fa]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[70647b0d-ba4a-4727-bc94-eafd42061222]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260]
Nov 10 12:21:13 user nova-compute[74889]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c, portal: 172.16.0.220,3260] successful.
Nov 10 12:21:13 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a903fda4-49d0-4f34-809e-8f9613e65b7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[45081888-a482-4a3a-8b60-3f6443fb42a3]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] <== disconnect_volume: return (343ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:21:13 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Deleting instance files /opt/stack/data/nova/instances/215c5f9c-13dd-45ba-a4d2-30fddb6e0fff_del
Nov 10 12:21:13 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Deletion of /opt/stack/data/nova/instances/215c5f9c-13dd-45ba-a4d2-30fddb6e0fff_del complete
Nov 10 12:21:13 user nova-compute[74889]: INFO nova.compute.manager [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 10 12:21:13 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:21:13 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:21:13 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Took 0.46 seconds to deallocate network for instance.
Nov 10 12:21:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-8ecc38fa-0b92-497a-b826-cfdc3b6404dc req-d2b609eb-1904-49c0-87aa-52dd492be1e6 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received event network-vif-deleted-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:14 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:21:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:21:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-47e7ffe0-9898-4e86-9fc9-fa22eb067265 req-68e82a1a-ec3b-451b-a3be-09a19b6c5195 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received event network-vif-plugged-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-47e7ffe0-9898-4e86-9fc9-fa22eb067265 req-68e82a1a-ec3b-451b-a3be-09a19b6c5195 service nova] Acquiring lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-47e7ffe0-9898-4e86-9fc9-fa22eb067265 req-68e82a1a-ec3b-451b-a3be-09a19b6c5195 service nova] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-47e7ffe0-9898-4e86-9fc9-fa22eb067265 req-68e82a1a-ec3b-451b-a3be-09a19b6c5195 service nova] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-47e7ffe0-9898-4e86-9fc9-fa22eb067265 req-68e82a1a-ec3b-451b-a3be-09a19b6c5195 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] No waiting events found dispatching network-vif-plugged-be7a9750-0602-490c-855b-5f6015d79ebd {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:14 user nova-compute[74889]: WARNING nova.compute.manager [req-47e7ffe0-9898-4e86-9fc9-fa22eb067265 req-68e82a1a-ec3b-451b-a3be-09a19b6c5195 service nova] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Received unexpected event network-vif-plugged-be7a9750-0602-490c-855b-5f6015d79ebd for instance with vm_state active and task_state deleting.
Nov 10 12:21:14 user nova-compute[74889]: INFO nova.compute.manager [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] [instance: 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff] Took 0.92 seconds to detach 1 volumes for instance.
Nov 10 12:21:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:15 user nova-compute[74889]: INFO nova.compute.manager [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Terminating instance
Nov 10 12:21:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:21:15 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Deleted allocations for instance 215c5f9c-13dd-45ba-a4d2-30fddb6e0fff
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-8de46c15-8cc7-4e70-948c-e100a0720f67 tempest-TestVolumeBootPattern-1577456798 tempest-TestVolumeBootPattern-1577456798-project-member] Lock "215c5f9c-13dd-45ba-a4d2-30fddb6e0fff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.127s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Instance destroyed successfully.
Nov 10 12:21:15 user nova-compute[74889]: DEBUG nova.objects.instance [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lazy-loading 'resources' on Instance uuid 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:13:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-137397044',display_name='tempest-ServerStableDeviceRescueTest-server-137397044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-137397044',id=38,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPiHED/O3YxLE3/Pozk1GrEwY9VoJaFyDb5ArKwcg5/nUF6NifLRMQLba9hOy2RYEEK6YhuTdNvZMDr9wwXh2lyTycQbYofYq9VLGyvvTKR+N5oDM7jKla4GRF4HwEP3w==',key_name='tempest-keypair-1720706475',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:18:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f2235110fb74639b0d81ee2c7586b8b',ramdisk_id='',reservation_id='r-8f9jgm34',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1835119920',owner_user_name='tempest-ServerStableDeviceRescueTest-1835119920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:19:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37f23ef8bc05432096fc0bbeb4b29aca',uuid=903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Converting VIF {"id": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "address": "fa:16:3e:c1:3f:39", "network": {"id": "184818ba-92f6-4840-89da-7721d94fb9e9", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-596210253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f2235110fb74639b0d81ee2c7586b8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c1e4117-f6", "ovs_interfaceid": "4c1e4117-f6a1-46d7-9864-d17dacfd1eea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:39,bridge_name='br-int',has_traffic_filtering=True,id=4c1e4117-f6a1-46d7-9864-d17dacfd1eea,network=Network(184818ba-92f6-4840-89da-7721d94fb9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e4117-f6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG os_vif [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:39,bridge_name='br-int',has_traffic_filtering=True,id=4c1e4117-f6a1-46d7-9864-d17dacfd1eea,network=Network(184818ba-92f6-4840-89da-7721d94fb9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e4117-f6') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c1e4117-f6, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c2feb3d-aa40-49ac-afba-d67cf2b9bfc8) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:21:15 user nova-compute[74889]: INFO os_vif [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:39,bridge_name='br-int',has_traffic_filtering=True,id=4c1e4117-f6a1-46d7-9864-d17dacfd1eea,network=Network(184818ba-92f6-4840-89da-7721d94fb9e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c1e4117-f6')
Nov 10 12:21:15 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Deleting instance files /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4_del
Nov 10 12:21:15 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Deletion of /opt/stack/data/nova/instances/903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4_del complete
Nov 10 12:21:16 user nova-compute[74889]: INFO nova.compute.manager [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 10 12:21:16 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:16 user nova-compute[74889]: WARNING nova.compute.manager [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state active and task_state deleting.
Nov 10 12:21:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:16 user nova-compute[74889]: WARNING nova.compute.manager [req-60442bb4-ea52-44b8-8aa0-beae45da1080 req-6b6d3e12-b2bf-4004-b381-b7c9440cba90 service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state active and task_state deleting.
Nov 10 12:21:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:17 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:21:17 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Took 1.23 seconds to deallocate network for instance.
Nov 10 12:21:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:17 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:21:17 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:21:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:17 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Deleted allocations for instance 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4
Nov 10 12:21:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c8aaa143-45d3-45bd-b0e6-99a78ac0d16b tempest-ServerStableDeviceRescueTest-1835119920 tempest-ServerStableDeviceRescueTest-1835119920-project-member] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.599s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:18 user nova-compute[74889]: WARNING nova.compute.manager [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state deleted and task_state None.
Nov 10 12:21:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:18 user nova-compute[74889]: WARNING nova.compute.manager [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-unplugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state deleted and task_state None.
Nov 10 12:21:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] Acquiring lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] Lock "903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] No waiting events found dispatching network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:18 user nova-compute[74889]: WARNING nova.compute.manager [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received unexpected event network-vif-plugged-4c1e4117-f6a1-46d7-9864-d17dacfd1eea for instance with vm_state deleted and task_state None.
Nov 10 12:21:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-c9b59601-930b-4760-8d61-2394fdfe8c6b req-ba75e69d-25bd-47e2-8f94-64167529de8b service nova] [instance: 903bb4e0-bfcb-4fd9-bb24-f24d71b97fe4] Received event network-vif-deleted-4c1e4117-f6a1-46d7-9864-d17dacfd1eea {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "7bc18e85-4acb-412e-9186-a37a076cf326" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:26 user nova-compute[74889]: INFO nova.compute.manager [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Terminating instance
Nov 10 12:21:26 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-3d99076c-fe78-4028-b03f-270748a6f204 req-42ab746e-f310-4549-9529-d5f9e36eccd5 service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received event network-vif-unplugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3d99076c-fe78-4028-b03f-270748a6f204 req-42ab746e-f310-4549-9529-d5f9e36eccd5 service nova] Acquiring lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3d99076c-fe78-4028-b03f-270748a6f204 req-42ab746e-f310-4549-9529-d5f9e36eccd5 service nova] Lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3d99076c-fe78-4028-b03f-270748a6f204 req-42ab746e-f310-4549-9529-d5f9e36eccd5 service nova] Lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-3d99076c-fe78-4028-b03f-270748a6f204 req-42ab746e-f310-4549-9529-d5f9e36eccd5 service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] No waiting events found dispatching network-vif-unplugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:26 user nova-compute[74889]: DEBUG nova.compute.manager [req-3d99076c-fe78-4028-b03f-270748a6f204 req-42ab746e-f310-4549-9529-d5f9e36eccd5 service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received event network-vif-unplugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:21:27 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Instance destroyed successfully.
Nov 10 12:21:27 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lazy-loading 'resources' on Instance uuid 7bc18e85-4acb-412e-9186-a37a076cf326 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-354119069',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-354119069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3541190',id=43,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc8tJb0VW6ZbqTstUC4mqjgnHfU4HjBfyX2yaT8fLDqyYq4skihjuFMc2t1d2RI+nUU7RiLhMpWgCHn3NWMXeHyiQJcnFlIz/3j1Qaq648e3C2HRmH9T+NUVs1fIwG/3w==',key_name='tempest-keypair-804478842',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:18:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9145ef914f7547d783ba55a709005576',ramdisk_id='',reservation_id='r-updo9uus',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2134497884',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:18:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3399214155124a05813668fa635eabcd',uuid=7bc18e85-4acb-412e-9186-a37a076cf326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Converting VIF {"id": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "address": "fa:16:3e:f3:75:6c", "network": {"id": "24af566c-5acc-4f81-80cb-05ec1accc0ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2010043619-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9145ef914f7547d783ba55a709005576", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe4493a2-57", "ovs_interfaceid": "fe4493a2-5797-4a0a-9b7f-58b128da4ecd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:75:6c,bridge_name='br-int',has_traffic_filtering=True,id=fe4493a2-5797-4a0a-9b7f-58b128da4ecd,network=Network(24af566c-5acc-4f81-80cb-05ec1accc0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4493a2-57') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG os_vif [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:75:6c,bridge_name='br-int',has_traffic_filtering=True,id=fe4493a2-5797-4a0a-9b7f-58b128da4ecd,network=Network(24af566c-5acc-4f81-80cb-05ec1accc0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4493a2-57') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe4493a2-57, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97ff9e19-63ba-4c28-9297-c543684760db) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:27 user nova-compute[74889]: INFO os_vif [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:75:6c,bridge_name='br-int',has_traffic_filtering=True,id=fe4493a2-5797-4a0a-9b7f-58b128da4ecd,network=Network(24af566c-5acc-4f81-80cb-05ec1accc0ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe4493a2-57')
Nov 10 12:21:27 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Deleting instance files /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326_del
Nov 10 12:21:27 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Deletion of /opt/stack/data/nova/instances/7bc18e85-4acb-412e-9186-a37a076cf326_del complete
Nov 10 12:21:27 user nova-compute[74889]: INFO nova.compute.manager [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 10 12:21:27 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:21:27 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:21:28 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:21:28 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Took 0.73 seconds to deallocate network for instance.
Nov 10 12:21:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:28 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:21:28 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:21:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:28 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Deleted allocations for instance 7bc18e85-4acb-412e-9186-a37a076cf326
Nov 10 12:21:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-f334809b-c9d1-4e94-bbf6-c83ffaa04845 req-27f10833-6235-4665-979e-09f1a255cb48 service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received event network-vif-plugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f334809b-c9d1-4e94-bbf6-c83ffaa04845 req-27f10833-6235-4665-979e-09f1a255cb48 service nova] Acquiring lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f334809b-c9d1-4e94-bbf6-c83ffaa04845 req-27f10833-6235-4665-979e-09f1a255cb48 service nova] Lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-f334809b-c9d1-4e94-bbf6-c83ffaa04845 req-27f10833-6235-4665-979e-09f1a255cb48 service nova] Lock "7bc18e85-4acb-412e-9186-a37a076cf326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-f334809b-c9d1-4e94-bbf6-c83ffaa04845 req-27f10833-6235-4665-979e-09f1a255cb48 service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] No waiting events found dispatching network-vif-plugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:28 user nova-compute[74889]: WARNING nova.compute.manager [req-f334809b-c9d1-4e94-bbf6-c83ffaa04845 req-27f10833-6235-4665-979e-09f1a255cb48 service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received unexpected event network-vif-plugged-fe4493a2-5797-4a0a-9b7f-58b128da4ecd for instance with vm_state deleted and task_state None.
Nov 10 12:21:28 user nova-compute[74889]: DEBUG nova.compute.manager [req-f334809b-c9d1-4e94-bbf6-c83ffaa04845 req-27f10833-6235-4665-979e-09f1a255cb48 service nova] [instance: 7bc18e85-4acb-412e-9186-a37a076cf326] Received event network-vif-deleted-fe4493a2-5797-4a0a-9b7f-58b128da4ecd {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6024ba49-c3f4-4bc0-9c73-b8704f0775c5 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884 tempest-TestServerVolumeAttachScenarioOldVersion-2134497884-project-member] Lock "7bc18e85-4acb-412e-9186-a37a076cf326" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.379s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:33 user nova-compute[74889]: INFO nova.compute.manager [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Rescuing
Nov 10 12:21:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:21:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquired lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:21:33 user nova-compute[74889]: DEBUG nova.network.neutron [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG nova.network.neutron [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updating instance_info_cache with network_info: [{"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Releasing lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-1e724339-4050-42a2-ae75-83ddff1cfd7a req-1c19921b-ba87-4573-9f01-cab8b008d2cd service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-unplugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1e724339-4050-42a2-ae75-83ddff1cfd7a req-1c19921b-ba87-4573-9f01-cab8b008d2cd service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1e724339-4050-42a2-ae75-83ddff1cfd7a req-1c19921b-ba87-4573-9f01-cab8b008d2cd service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1e724339-4050-42a2-ae75-83ddff1cfd7a req-1c19921b-ba87-4573-9f01-cab8b008d2cd service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-1e724339-4050-42a2-ae75-83ddff1cfd7a req-1c19921b-ba87-4573-9f01-cab8b008d2cd service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-unplugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:34 user nova-compute[74889]: WARNING nova.compute.manager [req-1e724339-4050-42a2-ae75-83ddff1cfd7a req-1c19921b-ba87-4573-9f01-cab8b008d2cd service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-unplugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state active and task_state rescuing.
Nov 10 12:21:34 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Instance destroyed successfully.
Nov 10 12:21:34 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Attempting rescue
Nov 10 12:21:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74889) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Instance directory exists: not creating {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 12:21:34 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Creating image(s)
Nov 10 12:21:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG nova.objects.instance [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'trusted_certs' on Instance uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue" returned: 0 in 0.055s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.objects.instance [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'migration_context' on Instance uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.objects.base [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<de32b888-15ed-42eb-9029-1cb3dc471253> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Start _get_guest_xml network_info=[{"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "vif_mac": "fa:16:3e:a1:a6:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.objects.instance [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'resources' on Instance uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.objects.base [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<de32b888-15ed-42eb-9029-1cb3dc471253> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.objects.instance [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'numa_topology' on Instance uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.objects.base [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<de32b888-15ed-42eb-9029-1cb3dc471253> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:21:35 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:21:35 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.objects.instance [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'vcpu_model' on Instance uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.objects.base [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<de32b888-15ed-42eb-9029-1cb3dc471253> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387647068',display_name='tempest-ServerRescueNegativeTestJSON-server-1387647068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1387647068',id=41,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:16:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-b2yoos3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:16:53Z,user_data=None,user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=de32b888-15ed-42eb-9029-1cb3dc471253,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "vif_mac": "fa:16:3e:a1:a6:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "vif_mac": "fa:16:3e:a1:a6:69"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=9d2cfd53-72da-4fb7-bc5d-c139019fa9e7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d2cfd53-72') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.objects.instance [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'pci_devices' on Instance uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.objects.base [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<de32b888-15ed-42eb-9029-1cb3dc471253> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:21:35 user nova-compute[74889]:   <uuid>de32b888-15ed-42eb-9029-1cb3dc471253</uuid>
Nov 10 12:21:35 user nova-compute[74889]:   <name>instance-00000029</name>
Nov 10 12:21:35 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:21:35 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:21:35 user nova-compute[74889]:   <metadata>
Nov 10 12:21:35 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:21:35 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:21:35 user nova-compute[74889]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1387647068</nova:name>
Nov 10 12:21:35 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:21:35</nova:creationTime>
Nov 10 12:21:35 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:21:35 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:21:35 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:21:35 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:21:35 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:21:35 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:21:35 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:21:35 user nova-compute[74889]:       <nova:owner>
Nov 10 12:21:35 user nova-compute[74889]:         <nova:user uuid="db6e671b33f14840b2a79a3affbbaaa8">tempest-ServerRescueNegativeTestJSON-524488673-project-member</nova:user>
Nov 10 12:21:35 user nova-compute[74889]:         <nova:project uuid="62c4b9efdfb14eadb63b747cc3c6003f">tempest-ServerRescueNegativeTestJSON-524488673</nova:project>
Nov 10 12:21:35 user nova-compute[74889]:       </nova:owner>
Nov 10 12:21:35 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:21:35 user nova-compute[74889]:       <nova:ports>
Nov 10 12:21:35 user nova-compute[74889]:         <nova:port uuid="9d2cfd53-72da-4fb7-bc5d-c139019fa9e7">
Nov 10 12:21:35 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 12:21:35 user nova-compute[74889]:         </nova:port>
Nov 10 12:21:35 user nova-compute[74889]:       </nova:ports>
Nov 10 12:21:35 user nova-compute[74889]:     </nova:instance>
Nov 10 12:21:35 user nova-compute[74889]:   </metadata>
Nov 10 12:21:35 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:21:35 user nova-compute[74889]:     <system>
Nov 10 12:21:35 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:21:35 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:21:35 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:21:35 user nova-compute[74889]:       <entry name="serial">de32b888-15ed-42eb-9029-1cb3dc471253</entry>
Nov 10 12:21:35 user nova-compute[74889]:       <entry name="uuid">de32b888-15ed-42eb-9029-1cb3dc471253</entry>
Nov 10 12:21:35 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:21:35 user nova-compute[74889]:     </system>
Nov 10 12:21:35 user nova-compute[74889]:   </sysinfo>
Nov 10 12:21:35 user nova-compute[74889]:   <os>
Nov 10 12:21:35 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:21:35 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:21:35 user nova-compute[74889]:   </os>
Nov 10 12:21:35 user nova-compute[74889]:   <features>
Nov 10 12:21:35 user nova-compute[74889]:     <acpi/>
Nov 10 12:21:35 user nova-compute[74889]:     <apic/>
Nov 10 12:21:35 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:21:35 user nova-compute[74889]:   </features>
Nov 10 12:21:35 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:21:35 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:21:35 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:21:35 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:21:35 user nova-compute[74889]:   </clock>
Nov 10 12:21:35 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:21:35 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:21:35 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:21:35 user nova-compute[74889]:   </cpu>
Nov 10 12:21:35 user nova-compute[74889]:   <devices>
Nov 10 12:21:35 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:21:35 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:21:35 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue"/>
Nov 10 12:21:35 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:21:35 user nova-compute[74889]:     </disk>
Nov 10 12:21:35 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:21:35 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:21:35 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk"/>
Nov 10 12:21:35 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 12:21:35 user nova-compute[74889]:     </disk>
Nov 10 12:21:35 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:21:35 user nova-compute[74889]:       <mac address="fa:16:3e:a1:a6:69"/>
Nov 10 12:21:35 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:21:35 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:21:35 user nova-compute[74889]:       <target dev="tap9d2cfd53-72"/>
Nov 10 12:21:35 user nova-compute[74889]:     </interface>
Nov 10 12:21:35 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:21:35 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/console.log" append="off"/>
Nov 10 12:21:35 user nova-compute[74889]:     </serial>
Nov 10 12:21:35 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:21:35 user nova-compute[74889]:     <video>
Nov 10 12:21:35 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:21:35 user nova-compute[74889]:     </video>
Nov 10 12:21:35 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:21:35 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:21:35 user nova-compute[74889]:     </rng>
Nov 10 12:21:35 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:21:35 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:21:35 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:21:35 user nova-compute[74889]:     </memballoon>
Nov 10 12:21:35 user nova-compute[74889]:   </devices>
Nov 10 12:21:35 user nova-compute[74889]: </domain>
Nov 10 12:21:35 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:21:35 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Instance destroyed successfully.
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:21:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No VIF found with MAC fa:16:3e:a1:a6:69, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:21:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-e62e4b36-332d-40e5-9125-c72e135a7be3 req-d163a6b2-7deb-4edb-8004-4a4663515016 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e62e4b36-332d-40e5-9125-c72e135a7be3 req-d163a6b2-7deb-4edb-8004-4a4663515016 service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e62e4b36-332d-40e5-9125-c72e135a7be3 req-d163a6b2-7deb-4edb-8004-4a4663515016 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e62e4b36-332d-40e5-9125-c72e135a7be3 req-d163a6b2-7deb-4edb-8004-4a4663515016 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-e62e4b36-332d-40e5-9125-c72e135a7be3 req-d163a6b2-7deb-4edb-8004-4a4663515016 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:36 user nova-compute[74889]: WARNING nova.compute.manager [req-e62e4b36-332d-40e5-9125-c72e135a7be3 req-d163a6b2-7deb-4edb-8004-4a4663515016 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state active and task_state rescuing.
Nov 10 12:21:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:38 user nova-compute[74889]: WARNING nova.compute.manager [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state active and task_state rescuing.
Nov 10 12:21:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:21:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:21:38 user nova-compute[74889]: WARNING nova.compute.manager [req-45d93854-afa2-450f-b639-72406fb7917d req-e55e365c-9f67-49ba-b0d1-081a1ca91e3b service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state active and task_state rescuing.
Nov 10 12:21:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-47c38557-c41d-4f38-bb30-7e8200968fa7 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:21:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:21:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:21:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:21:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:21:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:21:57 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:58 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:21:59 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:01 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:22:01 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8386MB free_disk=25.119277954101562GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:22:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:02 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:02 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:22:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:22:02 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:22:02 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:22:03 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updating instance_info_cache with network_info: [{"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:22:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:22:03 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:22:03 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:03 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:03 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:03 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:03 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 12:22:03 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 12:22:04 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:04 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 12:22:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:22:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:22:44 user nova-compute[74889]: INFO nova.compute.claims [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Claim successful on node user
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:22:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.policy [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7fd9b849c90c4f9e9adff2e895652d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbe1c66261049f39c0a3e03a6069b71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:22:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Creating image(s)
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "/opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "/opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "/opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:22:45 user nova-compute[74889]: INFO nova.compute.claims [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Claim successful on node user
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.197s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.205s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk 1073741824" returned: 0 in 0.045s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.network.neutron [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:22:45 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Successfully created port: 8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Cannot resize image /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Ensure instance console log exists: /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.policy [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b24ef2fdba14d0cbd34e08917e31ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547570bd00724bcaafedc05b2a266490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.compute.manager [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:22:45 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Creating image(s)
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "/opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "/opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "/opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:45 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk 1073741824" returned: 0 in 0.057s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Successfully updated port: 8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquired lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Successfully created port: b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-32328c89-8b04-4dc8-a9af-90451df8d5c1 req-275f7b49-26f7-4653-b52c-077603cf4036 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received event network-changed-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-32328c89-8b04-4dc8-a9af-90451df8d5c1 req-275f7b49-26f7-4653-b52c-077603cf4036 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Refreshing instance network info cache due to event network-changed-8821cea2-782e-4541-9656-f70486df1363. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-32328c89-8b04-4dc8-a9af-90451df8d5c1 req-275f7b49-26f7-4653-b52c-077603cf4036 service nova] Acquiring lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.218s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Cannot resize image /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Ensure instance console log exists: /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updating instance_info_cache with network_info: [{"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Releasing lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Instance network_info: |[{"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-32328c89-8b04-4dc8-a9af-90451df8d5c1 req-275f7b49-26f7-4653-b52c-077603cf4036 service nova] Acquired lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.network.neutron [req-32328c89-8b04-4dc8-a9af-90451df8d5c1 req-275f7b49-26f7-4653-b52c-077603cf4036 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Refreshing network info cache for port 8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Start _get_guest_xml network_info=[{"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:22:46 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:22:46 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1854413385',display_name='tempest-SnapshotDataIntegrityTests-server-1854413385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1854413385',id=46,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgycwc9Hr2kws4TmupzPTSqYSSJvAcdhL6+GCoBlrOaQzE95qEObbIlmeraCXTvl2meEHOmI8c+ioVF343D/pDd8hDKpJDNYBcw66jeX6TwUDz0Ov6fCQi0CO3znZYuyw==',key_name='tempest-keypair-240464443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bbe1c66261049f39c0a3e03a6069b71',ramdisk_id='',reservation_id='r-w06wa2ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1016155408',owner_user_name='tempest-SnapshotDataIntegrityTests-1016155408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:22:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd9b849c90c4f9e9adff2e895652d5a',uuid=d58137e4-403b-45af-b9fc-64a2c5efe819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Converting VIF {"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b5:4d,bridge_name='br-int',has_traffic_filtering=True,id=8821cea2-782e-4541-9656-f70486df1363,network=Network(1335036a-403c-40bb-be37-30c90856d35f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821cea2-78') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'pci_devices' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:22:46 user nova-compute[74889]:   <uuid>d58137e4-403b-45af-b9fc-64a2c5efe819</uuid>
Nov 10 12:22:46 user nova-compute[74889]:   <name>instance-0000002e</name>
Nov 10 12:22:46 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:22:46 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:22:46 user nova-compute[74889]:   <metadata>
Nov 10 12:22:46 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:22:46 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:22:46 user nova-compute[74889]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1854413385</nova:name>
Nov 10 12:22:46 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:22:46</nova:creationTime>
Nov 10 12:22:46 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:22:46 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:22:46 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:22:46 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:22:46 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:22:46 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:22:46 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:22:46 user nova-compute[74889]:       <nova:owner>
Nov 10 12:22:46 user nova-compute[74889]:         <nova:user uuid="7fd9b849c90c4f9e9adff2e895652d5a">tempest-SnapshotDataIntegrityTests-1016155408-project-member</nova:user>
Nov 10 12:22:46 user nova-compute[74889]:         <nova:project uuid="5bbe1c66261049f39c0a3e03a6069b71">tempest-SnapshotDataIntegrityTests-1016155408</nova:project>
Nov 10 12:22:46 user nova-compute[74889]:       </nova:owner>
Nov 10 12:22:46 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:22:46 user nova-compute[74889]:       <nova:ports>
Nov 10 12:22:46 user nova-compute[74889]:         <nova:port uuid="8821cea2-782e-4541-9656-f70486df1363">
Nov 10 12:22:46 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 12:22:46 user nova-compute[74889]:         </nova:port>
Nov 10 12:22:46 user nova-compute[74889]:       </nova:ports>
Nov 10 12:22:46 user nova-compute[74889]:     </nova:instance>
Nov 10 12:22:46 user nova-compute[74889]:   </metadata>
Nov 10 12:22:46 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:22:46 user nova-compute[74889]:     <system>
Nov 10 12:22:46 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:22:46 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:22:46 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:22:46 user nova-compute[74889]:       <entry name="serial">d58137e4-403b-45af-b9fc-64a2c5efe819</entry>
Nov 10 12:22:46 user nova-compute[74889]:       <entry name="uuid">d58137e4-403b-45af-b9fc-64a2c5efe819</entry>
Nov 10 12:22:46 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:22:46 user nova-compute[74889]:     </system>
Nov 10 12:22:46 user nova-compute[74889]:   </sysinfo>
Nov 10 12:22:46 user nova-compute[74889]:   <os>
Nov 10 12:22:46 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:22:46 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:22:46 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:22:46 user nova-compute[74889]:   </os>
Nov 10 12:22:46 user nova-compute[74889]:   <features>
Nov 10 12:22:46 user nova-compute[74889]:     <acpi/>
Nov 10 12:22:46 user nova-compute[74889]:     <apic/>
Nov 10 12:22:46 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:22:46 user nova-compute[74889]:   </features>
Nov 10 12:22:46 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:22:46 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:22:46 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:22:46 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:22:46 user nova-compute[74889]:   </clock>
Nov 10 12:22:46 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:22:46 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:22:46 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:22:46 user nova-compute[74889]:   </cpu>
Nov 10 12:22:46 user nova-compute[74889]:   <devices>
Nov 10 12:22:46 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:22:46 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:22:46 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk"/>
Nov 10 12:22:46 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:22:46 user nova-compute[74889]:     </disk>
Nov 10 12:22:46 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:22:46 user nova-compute[74889]:       <mac address="fa:16:3e:bc:b5:4d"/>
Nov 10 12:22:46 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:22:46 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:22:46 user nova-compute[74889]:       <target dev="tap8821cea2-78"/>
Nov 10 12:22:46 user nova-compute[74889]:     </interface>
Nov 10 12:22:46 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:22:46 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/console.log" append="off"/>
Nov 10 12:22:46 user nova-compute[74889]:     </serial>
Nov 10 12:22:46 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:22:46 user nova-compute[74889]:     <video>
Nov 10 12:22:46 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:22:46 user nova-compute[74889]:     </video>
Nov 10 12:22:46 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:22:46 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:22:46 user nova-compute[74889]:     </rng>
Nov 10 12:22:46 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:22:46 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:22:46 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:22:46 user nova-compute[74889]:     </memballoon>
Nov 10 12:22:46 user nova-compute[74889]:   </devices>
Nov 10 12:22:46 user nova-compute[74889]: </domain>
Nov 10 12:22:46 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1854413385',display_name='tempest-SnapshotDataIntegrityTests-server-1854413385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1854413385',id=46,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgycwc9Hr2kws4TmupzPTSqYSSJvAcdhL6+GCoBlrOaQzE95qEObbIlmeraCXTvl2meEHOmI8c+ioVF343D/pDd8hDKpJDNYBcw66jeX6TwUDz0Ov6fCQi0CO3znZYuyw==',key_name='tempest-keypair-240464443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bbe1c66261049f39c0a3e03a6069b71',ramdisk_id='',reservation_id='r-w06wa2ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1016155408',owner_user_name='tempest-SnapshotDataIntegrityTests-1016155408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:22:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd9b849c90c4f9e9adff2e895652d5a',uuid=d58137e4-403b-45af-b9fc-64a2c5efe819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Converting VIF {"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b5:4d,bridge_name='br-int',has_traffic_filtering=True,id=8821cea2-782e-4541-9656-f70486df1363,network=Network(1335036a-403c-40bb-be37-30c90856d35f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821cea2-78') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG os_vif [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b5:4d,bridge_name='br-int',has_traffic_filtering=True,id=8821cea2-782e-4541-9656-f70486df1363,network=Network(1335036a-403c-40bb-be37-30c90856d35f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821cea2-78') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe7d4b41-2b31-5dd6-bb33-555037dee0ab', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8821cea2-78, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8821cea2-78, col_values=(('qos', UUID('d8452d6e-5c29-45fe-b443-7b9f8596e631')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8821cea2-78, col_values=(('external_ids', {'iface-id': '8821cea2-782e-4541-9656-f70486df1363', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:b5:4d', 'vm-uuid': 'd58137e4-403b-45af-b9fc-64a2c5efe819'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:46 user nova-compute[74889]: INFO os_vif [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b5:4d,bridge_name='br-int',has_traffic_filtering=True,id=8821cea2-782e-4541-9656-f70486df1363,network=Network(1335036a-403c-40bb-be37-30c90856d35f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821cea2-78')
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:22:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No VIF found with MAC fa:16:3e:bc:b5:4d, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.neutron [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Successfully updated port: b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquired lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.neutron [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.neutron [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-1d060865-2f08-4143-aff7-91cd49768e53 req-7968ba5d-3dd2-482f-ac1b-707459c9d679 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-changed-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-1d060865-2f08-4143-aff7-91cd49768e53 req-7968ba5d-3dd2-482f-ac1b-707459c9d679 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Refreshing instance network info cache due to event network-changed-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1d060865-2f08-4143-aff7-91cd49768e53 req-7968ba5d-3dd2-482f-ac1b-707459c9d679 service nova] Acquiring lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-32328c89-8b04-4dc8-a9af-90451df8d5c1 req-275f7b49-26f7-4653-b52c-077603cf4036 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updated VIF entry in instance network info cache for port 8821cea2-782e-4541-9656-f70486df1363. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-32328c89-8b04-4dc8-a9af-90451df8d5c1 req-275f7b49-26f7-4653-b52c-077603cf4036 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updating instance_info_cache with network_info: [{"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-32328c89-8b04-4dc8-a9af-90451df8d5c1 req-275f7b49-26f7-4653-b52c-077603cf4036 service nova] Releasing lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.neutron [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating instance_info_cache with network_info: [{"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Releasing lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance network_info: |[{"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1d060865-2f08-4143-aff7-91cd49768e53 req-7968ba5d-3dd2-482f-ac1b-707459c9d679 service nova] Acquired lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-1d060865-2f08-4143-aff7-91cd49768e53 req-7968ba5d-3dd2-482f-ac1b-707459c9d679 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Refreshing network info cache for port b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Start _get_guest_xml network_info=[{"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:22:47 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:22:47 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2053678616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2053678616',id=47,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAi+CFstq2853qShl+H0CVY3FFH6hxyBnSO7JBWtayf1NbcqqH38RXu0/Qh13T/4HP2p50UEbiVYZgFUY3XwtK169awAETyoIQGYPwXHbsYMu3PdwGMCB3LdMdrAyr9s7A==',key_name='tempest-keypair-1550139395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-bw70m0dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=73d95044-495c-4254-b14b-3a02c1c1dfd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.objects.instance [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'pci_devices' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:22:47 user nova-compute[74889]:   <uuid>73d95044-495c-4254-b14b-3a02c1c1dfd8</uuid>
Nov 10 12:22:47 user nova-compute[74889]:   <name>instance-0000002f</name>
Nov 10 12:22:47 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:22:47 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:22:47 user nova-compute[74889]:   <metadata>
Nov 10 12:22:47 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:22:47 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:22:47 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2053678616</nova:name>
Nov 10 12:22:47 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:22:47</nova:creationTime>
Nov 10 12:22:47 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:22:47 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:22:47 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:22:47 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:22:47 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:22:47 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:22:47 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:22:47 user nova-compute[74889]:       <nova:owner>
Nov 10 12:22:47 user nova-compute[74889]:         <nova:user uuid="5b24ef2fdba14d0cbd34e08917e31ae5">tempest-AttachVolumeShelveTestJSON-651460361-project-member</nova:user>
Nov 10 12:22:47 user nova-compute[74889]:         <nova:project uuid="547570bd00724bcaafedc05b2a266490">tempest-AttachVolumeShelveTestJSON-651460361</nova:project>
Nov 10 12:22:47 user nova-compute[74889]:       </nova:owner>
Nov 10 12:22:47 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:22:47 user nova-compute[74889]:       <nova:ports>
Nov 10 12:22:47 user nova-compute[74889]:         <nova:port uuid="b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f">
Nov 10 12:22:47 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 12:22:47 user nova-compute[74889]:         </nova:port>
Nov 10 12:22:47 user nova-compute[74889]:       </nova:ports>
Nov 10 12:22:47 user nova-compute[74889]:     </nova:instance>
Nov 10 12:22:47 user nova-compute[74889]:   </metadata>
Nov 10 12:22:47 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:22:47 user nova-compute[74889]:     <system>
Nov 10 12:22:47 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:22:47 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:22:47 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:22:47 user nova-compute[74889]:       <entry name="serial">73d95044-495c-4254-b14b-3a02c1c1dfd8</entry>
Nov 10 12:22:47 user nova-compute[74889]:       <entry name="uuid">73d95044-495c-4254-b14b-3a02c1c1dfd8</entry>
Nov 10 12:22:47 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:22:47 user nova-compute[74889]:     </system>
Nov 10 12:22:47 user nova-compute[74889]:   </sysinfo>
Nov 10 12:22:47 user nova-compute[74889]:   <os>
Nov 10 12:22:47 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:22:47 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:22:47 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:22:47 user nova-compute[74889]:   </os>
Nov 10 12:22:47 user nova-compute[74889]:   <features>
Nov 10 12:22:47 user nova-compute[74889]:     <acpi/>
Nov 10 12:22:47 user nova-compute[74889]:     <apic/>
Nov 10 12:22:47 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:22:47 user nova-compute[74889]:   </features>
Nov 10 12:22:47 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:22:47 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:22:47 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:22:47 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:22:47 user nova-compute[74889]:   </clock>
Nov 10 12:22:47 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:22:47 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:22:47 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:22:47 user nova-compute[74889]:   </cpu>
Nov 10 12:22:47 user nova-compute[74889]:   <devices>
Nov 10 12:22:47 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:22:47 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:22:47 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk"/>
Nov 10 12:22:47 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:22:47 user nova-compute[74889]:     </disk>
Nov 10 12:22:47 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:22:47 user nova-compute[74889]:       <mac address="fa:16:3e:d5:aa:d8"/>
Nov 10 12:22:47 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:22:47 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:22:47 user nova-compute[74889]:       <target dev="tapb76e6a59-56"/>
Nov 10 12:22:47 user nova-compute[74889]:     </interface>
Nov 10 12:22:47 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:22:47 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/console.log" append="off"/>
Nov 10 12:22:47 user nova-compute[74889]:     </serial>
Nov 10 12:22:47 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:22:47 user nova-compute[74889]:     <video>
Nov 10 12:22:47 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:22:47 user nova-compute[74889]:     </video>
Nov 10 12:22:47 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:22:47 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:22:47 user nova-compute[74889]:     </rng>
Nov 10 12:22:47 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:22:47 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:22:47 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:22:47 user nova-compute[74889]:     </memballoon>
Nov 10 12:22:47 user nova-compute[74889]:   </devices>
Nov 10 12:22:47 user nova-compute[74889]: </domain>
Nov 10 12:22:47 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2053678616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2053678616',id=47,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAi+CFstq2853qShl+H0CVY3FFH6hxyBnSO7JBWtayf1NbcqqH38RXu0/Qh13T/4HP2p50UEbiVYZgFUY3XwtK169awAETyoIQGYPwXHbsYMu3PdwGMCB3LdMdrAyr9s7A==',key_name='tempest-keypair-1550139395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-bw70m0dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=73d95044-495c-4254-b14b-3a02c1c1dfd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG os_vif [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0fb8d36-29a9-5169-8aab-04efb4e173c4', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb76e6a59-56, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb76e6a59-56, col_values=(('qos', UUID('b7bc340c-deee-4e27-bce6-c98ad636fc1d')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb76e6a59-56, col_values=(('external_ids', {'iface-id': 'b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:aa:d8', 'vm-uuid': '73d95044-495c-4254-b14b-3a02c1c1dfd8'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:47 user nova-compute[74889]: INFO os_vif [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56')
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] No VIF found with MAC fa:16:3e:d5:aa:d8, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:22:47 user nova-compute[74889]: INFO nova.compute.manager [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] instance snapshotting
Nov 10 12:22:47 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Beginning live snapshot process
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-1d060865-2f08-4143-aff7-91cd49768e53 req-7968ba5d-3dd2-482f-ac1b-707459c9d679 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updated VIF entry in instance network info cache for port b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG nova.network.neutron [req-1d060865-2f08-4143-aff7-91cd49768e53 req-7968ba5d-3dd2-482f-ac1b-707459c9d679 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating instance_info_cache with network_info: [{"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1d060865-2f08-4143-aff7-91cd49768e53 req-7968ba5d-3dd2-482f-ac1b-707459c9d679 service nova] Releasing lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json -f qcow2 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json -f qcow2 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1juo8gn3/8aa5990668174fe89c8a9621ddec1925.delta 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:48 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1juo8gn3/8aa5990668174fe89c8a9621ddec1925.delta 1073741824" returned: 0 in 0.083s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:48 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 12:22:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 12:22:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74889) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 12:22:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 12:22:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-9ef2a1de-7a87-426e-b27d-091ebef9fdbc req-0b229944-f703-4bbc-93a6-7a5aae9ac94b service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:22:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9ef2a1de-7a87-426e-b27d-091ebef9fdbc req-0b229944-f703-4bbc-93a6-7a5aae9ac94b service nova] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9ef2a1de-7a87-426e-b27d-091ebef9fdbc req-0b229944-f703-4bbc-93a6-7a5aae9ac94b service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9ef2a1de-7a87-426e-b27d-091ebef9fdbc req-0b229944-f703-4bbc-93a6-7a5aae9ac94b service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-9ef2a1de-7a87-426e-b27d-091ebef9fdbc req-0b229944-f703-4bbc-93a6-7a5aae9ac94b service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] No waiting events found dispatching network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:22:49 user nova-compute[74889]: WARNING nova.compute.manager [req-9ef2a1de-7a87-426e-b27d-091ebef9fdbc req-0b229944-f703-4bbc-93a6-7a5aae9ac94b service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received unexpected event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f for instance with vm_state building and task_state spawning.
Nov 10 12:22:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:50 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:22:50 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1juo8gn3/8aa5990668174fe89c8a9621ddec1925.delta /opt/stack/data/nova/instances/snapshots/tmp1juo8gn3/8aa5990668174fe89c8a9621ddec1925 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:22:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:50 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1juo8gn3/8aa5990668174fe89c8a9621ddec1925.delta /opt/stack/data/nova/instances/snapshots/tmp1juo8gn3/8aa5990668174fe89c8a9621ddec1925" returned: 0 in 0.731s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:22:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Snapshot extracted, beginning image upload
Nov 10 12:22:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] No waiting events found dispatching network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:22:52 user nova-compute[74889]: WARNING nova.compute.manager [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received unexpected event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f for instance with vm_state building and task_state spawning.
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received event network-vif-plugged-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] No waiting events found dispatching network-vif-plugged-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:22:52 user nova-compute[74889]: WARNING nova.compute.manager [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received unexpected event network-vif-plugged-8821cea2-782e-4541-9656-f70486df1363 for instance with vm_state building and task_state spawning.
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received event network-vif-plugged-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] No waiting events found dispatching network-vif-plugged-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:22:52 user nova-compute[74889]: WARNING nova.compute.manager [req-663862d3-13b3-4873-b6d6-79ba2ddaf800 req-0b96307a-4c7d-434d-b6c2-f36eb36146e1 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received unexpected event network-vif-plugged-8821cea2-782e-4541-9656-f70486df1363 for instance with vm_state building and task_state spawning.
Nov 10 12:22:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:22:52 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance spawned successfully.
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:22:52 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Instance spawned successfully.
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:22:52 user nova-compute[74889]: INFO nova.compute.manager [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Took 7.05 seconds to spawn the instance on the hypervisor.
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:22:52 user nova-compute[74889]: INFO nova.compute.manager [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Took 7.99 seconds to spawn the instance on the hypervisor.
Nov 10 12:22:52 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:22:52 user nova-compute[74889]: INFO nova.compute.manager [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Took 7.95 seconds to build instance.
Nov 10 12:22:52 user nova-compute[74889]: INFO nova.compute.manager [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Took 8.71 seconds to build instance.
Nov 10 12:22:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-744365d6-29aa-4602-ad54-68a1e1272c6f tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.084s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:53 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1210621e-7149-436e-8d1d-6b4d74ffda4c tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.815s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:22:53 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Snapshot image upload complete
Nov 10 12:22:53 user nova-compute[74889]: INFO nova.compute.manager [None req-a3b4ef23-8fde-4949-a38d-fc9b5268aae1 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Took 5.85 seconds to snapshot the instance on the hypervisor.
Nov 10 12:22:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:22:58 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:22:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:22:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:22:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:22:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:22:59 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updating instance_info_cache with network_info: [{"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:22:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:22:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:22:59 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:23:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:23:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:23:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8255MB free_disk=25.05620574951172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing inventories for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating ProviderTree inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing aggregate associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, aggregates: None {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing trait associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:23:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:23:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:23:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:23:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:23:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:23:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:23:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:23:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:20 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:23:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:24 user nova-compute[74889]: INFO nova.compute.manager [None req-83f33588-0dd4-434c-b95f-aef1574d9640 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Unrescuing
Nov 10 12:23:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-83f33588-0dd4-434c-b95f-aef1574d9640 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:23:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-83f33588-0dd4-434c-b95f-aef1574d9640 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquired lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:23:24 user nova-compute[74889]: DEBUG nova.network.neutron [None req-83f33588-0dd4-434c-b95f-aef1574d9640 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG nova.network.neutron [None req-83f33588-0dd4-434c-b95f-aef1574d9640 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updating instance_info_cache with network_info: [{"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-83f33588-0dd4-434c-b95f-aef1574d9640 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Releasing lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG nova.objects.instance [None req-83f33588-0dd4-434c-b95f-aef1574d9640 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'flavor' on Instance uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-dcd65249-90ab-449a-a9f5-d4a88198d856 req-c8692470-1f15-4a47-a65d-20a3ab59acd0 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-unplugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-dcd65249-90ab-449a-a9f5-d4a88198d856 req-c8692470-1f15-4a47-a65d-20a3ab59acd0 service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-dcd65249-90ab-449a-a9f5-d4a88198d856 req-c8692470-1f15-4a47-a65d-20a3ab59acd0 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-dcd65249-90ab-449a-a9f5-d4a88198d856 req-c8692470-1f15-4a47-a65d-20a3ab59acd0 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-dcd65249-90ab-449a-a9f5-d4a88198d856 req-c8692470-1f15-4a47-a65d-20a3ab59acd0 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-unplugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:23:25 user nova-compute[74889]: WARNING nova.compute.manager [req-dcd65249-90ab-449a-a9f5-d4a88198d856 req-c8692470-1f15-4a47-a65d-20a3ab59acd0 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-unplugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:23:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:25 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Instance destroyed successfully.
Nov 10 12:23:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:23:27 user nova-compute[74889]: WARNING nova.compute.manager [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:23:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:23:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:23:27 user nova-compute[74889]: WARNING nova.compute.manager [req-5ddc3435-e54c-4b63-89ea-ae608b50dd7a req-d1e72b15-4cfe-4d54-9950-2b86283ca083 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:23:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-83f33588-0dd4-434c-b95f-aef1574d9640 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:23:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-d5f435b0-5f30-48cd-bf2e-ecd9a2850ee0 req-1da546fd-fcb9-46c7-88a1-0b93485ab919 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:23:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5f435b0-5f30-48cd-bf2e-ecd9a2850ee0 req-1da546fd-fcb9-46c7-88a1-0b93485ab919 service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:23:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5f435b0-5f30-48cd-bf2e-ecd9a2850ee0 req-1da546fd-fcb9-46c7-88a1-0b93485ab919 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:23:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d5f435b0-5f30-48cd-bf2e-ecd9a2850ee0 req-1da546fd-fcb9-46c7-88a1-0b93485ab919 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:23:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-d5f435b0-5f30-48cd-bf2e-ecd9a2850ee0 req-1da546fd-fcb9-46c7-88a1-0b93485ab919 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:23:29 user nova-compute[74889]: WARNING nova.compute.manager [req-d5f435b0-5f30-48cd-bf2e-ecd9a2850ee0 req-1da546fd-fcb9-46c7-88a1-0b93485ab919 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state active and task_state None.
Nov 10 12:23:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "bc9274ab-2362-42b1-a8af-06811513be55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:23:55 user nova-compute[74889]: INFO nova.compute.claims [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Claim successful on node user
Nov 10 12:23:55 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:23:55 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:23:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:23:55 user nova-compute[74889]: DEBUG nova.policy [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c2a48cfc9e04a2dbd2ad51b70c8b114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '757eef88e9c04404a1ddedfa23b6031d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:23:55 user nova-compute[74889]: INFO nova.virt.block_device [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Booting with volume-backed-image b0074759-91cd-4b7c-8386-071a17ff617a at /dev/vda
Nov 10 12:23:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Successfully created port: 0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:23:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Successfully updated port: 0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:23:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:23:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquired lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:23:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:23:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-97faf62c-ab24-42ae-80a9-61ffaa036ba9 req-5ec05b18-375c-4c01-af61-bbd23fc51384 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-changed-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:23:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-97faf62c-ab24-42ae-80a9-61ffaa036ba9 req-5ec05b18-375c-4c01-af61-bbd23fc51384 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Refreshing instance network info cache due to event network-changed-0f385cdf-45ca-4c25-8627-d1c23437ae5e. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:23:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-97faf62c-ab24-42ae-80a9-61ffaa036ba9 req-5ec05b18-375c-4c01-af61-bbd23fc51384 service nova] Acquiring lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:23:56 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:23:57 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Updating instance_info_cache with network_info: [{"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:23:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Releasing lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:23:57 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Instance network_info: |[{"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:23:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-97faf62c-ab24-42ae-80a9-61ffaa036ba9 req-5ec05b18-375c-4c01-af61-bbd23fc51384 service nova] Acquired lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:23:57 user nova-compute[74889]: DEBUG nova.network.neutron [req-97faf62c-ab24-42ae-80a9-61ffaa036ba9 req-5ec05b18-375c-4c01-af61-bbd23fc51384 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Refreshing network info cache for port 0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:23:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:23:57 user nova-compute[74889]: DEBUG nova.network.neutron [req-97faf62c-ab24-42ae-80a9-61ffaa036ba9 req-5ec05b18-375c-4c01-af61-bbd23fc51384 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Updated VIF entry in instance network info cache for port 0f385cdf-45ca-4c25-8627-d1c23437ae5e. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:23:57 user nova-compute[74889]: DEBUG nova.network.neutron [req-97faf62c-ab24-42ae-80a9-61ffaa036ba9 req-5ec05b18-375c-4c01-af61-bbd23fc51384 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Updating instance_info_cache with network_info: [{"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:23:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-97faf62c-ab24-42ae-80a9-61ffaa036ba9 req-5ec05b18-375c-4c01-af61-bbd23fc51384 service nova] Releasing lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Skipping network cache update for instance because it is Building. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid 662a3c8c-e0b0-4dea-b620-d11de1c5a92e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updating instance_info_cache with network_info: [{"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:00 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:24:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8201MB free_disk=24.998905181884766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance bc9274ab-2362-42b1-a8af-06811513be55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:24:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:24:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:24:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:24:07 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:24:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:24:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:24:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG os_brick.utils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d710f-419a-4527-b375-13b66bcff1a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[451772e7-a9b0-4d02-9775-7c1ebac4d08a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3a3d83-622d-4364-b17d-6097f037c38d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f944fb5-b60d-4fe8-9bd8-9988fe7f40e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:24:16 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:24:16 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eaa010-1997-40cb-8f27-99f1604d17a2]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG os_brick.utils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:24:16 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Updating existing volume attachment record: 841c20f1-e9e7-4970-bb3e-5c7e3d0ae0ad {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:24:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3b84fac-5385-407c-aa58-a167eee69260 req-b562f442-c15b-4c3d-91a1-eeedba65b192 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received event network-changed-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-e3b84fac-5385-407c-aa58-a167eee69260 req-b562f442-c15b-4c3d-91a1-eeedba65b192 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Refreshing instance network info cache due to event network-changed-8821cea2-782e-4541-9656-f70486df1363. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3b84fac-5385-407c-aa58-a167eee69260 req-b562f442-c15b-4c3d-91a1-eeedba65b192 service nova] Acquiring lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3b84fac-5385-407c-aa58-a167eee69260 req-b562f442-c15b-4c3d-91a1-eeedba65b192 service nova] Acquired lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-e3b84fac-5385-407c-aa58-a167eee69260 req-b562f442-c15b-4c3d-91a1-eeedba65b192 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Refreshing network info cache for port 8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-e3b84fac-5385-407c-aa58-a167eee69260 req-b562f442-c15b-4c3d-91a1-eeedba65b192 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updated VIF entry in instance network info cache for port 8821cea2-782e-4541-9656-f70486df1363. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-e3b84fac-5385-407c-aa58-a167eee69260 req-b562f442-c15b-4c3d-91a1-eeedba65b192 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updating instance_info_cache with network_info: [{"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e3b84fac-5385-407c-aa58-a167eee69260 req-b562f442-c15b-4c3d-91a1-eeedba65b192 service nova] Releasing lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-60b6688a-d138-4206-a483-f16d12cd81c0 req-4ead2c9f-1c7a-432a-8d08-892951eaab4e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-changed-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-60b6688a-d138-4206-a483-f16d12cd81c0 req-4ead2c9f-1c7a-432a-8d08-892951eaab4e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Refreshing instance network info cache due to event network-changed-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60b6688a-d138-4206-a483-f16d12cd81c0 req-4ead2c9f-1c7a-432a-8d08-892951eaab4e service nova] Acquiring lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60b6688a-d138-4206-a483-f16d12cd81c0 req-4ead2c9f-1c7a-432a-8d08-892951eaab4e service nova] Acquired lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:24:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-60b6688a-d138-4206-a483-f16d12cd81c0 req-4ead2c9f-1c7a-432a-8d08-892951eaab4e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Refreshing network info cache for port b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:24:36 user nova-compute[74889]: DEBUG nova.network.neutron [req-60b6688a-d138-4206-a483-f16d12cd81c0 req-4ead2c9f-1c7a-432a-8d08-892951eaab4e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updated VIF entry in instance network info cache for port b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:24:36 user nova-compute[74889]: DEBUG nova.network.neutron [req-60b6688a-d138-4206-a483-f16d12cd81c0 req-4ead2c9f-1c7a-432a-8d08-892951eaab4e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating instance_info_cache with network_info: [{"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:24:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-60b6688a-d138-4206-a483-f16d12cd81c0 req-4ead2c9f-1c7a-432a-8d08-892951eaab4e service nova] Releasing lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:24:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:24:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:24:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:24:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:24:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:42 user nova-compute[74889]: DEBUG nova.objects.instance [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:24:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:43 user nova-compute[74889]: INFO nova.compute.manager [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attaching volume 5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 to /dev/vdb
Nov 10 12:24:43 user nova-compute[74889]: DEBUG os_brick.utils [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee80afe-75f4-4b66-a3b4-b6b9baf094fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd944a7-4a6b-45d4-9776-efc3653f8bce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94eee3c-8013-4f02-933a-bba59ab995fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a820314-c9b8-4eea-8a50-7c2ede02ce5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:24:43 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:24:43 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[de55f6dd-38be-43be-8f16-a51a5e371ee2]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG os_brick.utils [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:24:43 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updating existing volume attachment record: 3c43d443-fbb8-4e17-82cf-5c47aa91cb58 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:24:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Creating image(s)
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Did not create local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Ensure instance console log exists: /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Start _get_guest_xml network_info=[{"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnmorNbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bc9274ab-2362-42b1-a8af-06811513be55', 'attached_at': '', 'detached_at': '', 'volume_id': '41f28e7d-9fa0-41a9-931a-42cdbb823273', 'serial': '41f28e7d-9fa0-41a9-931a-42cdbb823273'}, 'disk_bus': 'virtio', 'attachment_id': '841c20f1-e9e7-4970-bb3e-5c7e3d0ae0ad', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:24:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:24:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnmorNbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:24:44 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:24:44 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:24:44 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33ba31e-277b-49cf-922f-98c8a4c84d9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:24:44 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e9358a-30f4-4aa2-819b-6c04e8527adb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273] added
Nov 10 12:24:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc96ee3d-50e6-47d3-ab54-45158743d6f0]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9badac-806f-4203-9a70-2a51e0a44258]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnmorNbT {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnmorNbT" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cc5544-b32b-4cf4-a8a9-2af6692b894c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cnmorNbT'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffc900c-6bd0-4137-b3ae-0ca6b6ab3750]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5b02ee-7f56-4e23-ac0f-0518ff69e250]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:24:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:24:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[367da5bf-ecb1-438b-97f6-3a3e0aa93100]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273, portal: 172.16.0.220,3260]
Nov 10 12:24:44 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273, portal: 172.16.0.220,3260] successful.
Nov 10 12:24:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[454fa732-bc5d-44fe-9059-ff4c9f54bcd4]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[878ca8f0-8908-455d-9f8a-68d3aa99cdec]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:24:44 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:24:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:24:44 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:24:44 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5658b505-bdf9-4de4-be1b-0e72b8664f86]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:24:44 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnmorNbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26136656433623132', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136656433623132', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1717297090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1717297090',id=48,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-91amqoxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:23:56Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=bc9274ab-2362-42b1-a8af-06811513be55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:36:50,bridge_name='br-int',has_traffic_filtering=True,id=0f385cdf-45ca-4c25-8627-d1c23437ae5e,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f385cdf-45') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'pci_devices' on Instance uuid bc9274ab-2362-42b1-a8af-06811513be55 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:24:45 user nova-compute[74889]:   <uuid>bc9274ab-2362-42b1-a8af-06811513be55</uuid>
Nov 10 12:24:45 user nova-compute[74889]:   <name>instance-00000030</name>
Nov 10 12:24:45 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:24:45 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:24:45 user nova-compute[74889]:   <metadata>
Nov 10 12:24:45 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:24:45 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:24:45 user nova-compute[74889]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1717297090</nova:name>
Nov 10 12:24:45 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:24:44</nova:creationTime>
Nov 10 12:24:45 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:24:45 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:24:45 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:24:45 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:24:45 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:24:45 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:24:45 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:24:45 user nova-compute[74889]:       <nova:owner>
Nov 10 12:24:45 user nova-compute[74889]:         <nova:user uuid="4c2a48cfc9e04a2dbd2ad51b70c8b114">tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member</nova:user>
Nov 10 12:24:45 user nova-compute[74889]:         <nova:project uuid="757eef88e9c04404a1ddedfa23b6031d">tempest-ServerBootFromVolumeStableRescueTest-1484079705</nova:project>
Nov 10 12:24:45 user nova-compute[74889]:       </nova:owner>
Nov 10 12:24:45 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:24:45 user nova-compute[74889]:       <nova:ports>
Nov 10 12:24:45 user nova-compute[74889]:         <nova:port uuid="0f385cdf-45ca-4c25-8627-d1c23437ae5e">
Nov 10 12:24:45 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 12:24:45 user nova-compute[74889]:         </nova:port>
Nov 10 12:24:45 user nova-compute[74889]:       </nova:ports>
Nov 10 12:24:45 user nova-compute[74889]:     </nova:instance>
Nov 10 12:24:45 user nova-compute[74889]:   </metadata>
Nov 10 12:24:45 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:24:45 user nova-compute[74889]:     <system>
Nov 10 12:24:45 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:24:45 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:24:45 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:24:45 user nova-compute[74889]:       <entry name="serial">bc9274ab-2362-42b1-a8af-06811513be55</entry>
Nov 10 12:24:45 user nova-compute[74889]:       <entry name="uuid">bc9274ab-2362-42b1-a8af-06811513be55</entry>
Nov 10 12:24:45 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:24:45 user nova-compute[74889]:     </system>
Nov 10 12:24:45 user nova-compute[74889]:   </sysinfo>
Nov 10 12:24:45 user nova-compute[74889]:   <os>
Nov 10 12:24:45 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:24:45 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:24:45 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:24:45 user nova-compute[74889]:   </os>
Nov 10 12:24:45 user nova-compute[74889]:   <features>
Nov 10 12:24:45 user nova-compute[74889]:     <acpi/>
Nov 10 12:24:45 user nova-compute[74889]:     <apic/>
Nov 10 12:24:45 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:24:45 user nova-compute[74889]:   </features>
Nov 10 12:24:45 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:24:45 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:24:45 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:24:45 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:24:45 user nova-compute[74889]:   </clock>
Nov 10 12:24:45 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:24:45 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:24:45 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:24:45 user nova-compute[74889]:   </cpu>
Nov 10 12:24:45 user nova-compute[74889]:   <devices>
Nov 10 12:24:45 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:24:45 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:24:45 user nova-compute[74889]:       <source dev="/dev/sdc"/>
Nov 10 12:24:45 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:24:45 user nova-compute[74889]:       <serial>41f28e7d-9fa0-41a9-931a-42cdbb823273</serial>
Nov 10 12:24:45 user nova-compute[74889]:     </disk>
Nov 10 12:24:45 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:24:45 user nova-compute[74889]:       <mac address="fa:16:3e:f2:36:50"/>
Nov 10 12:24:45 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:24:45 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:24:45 user nova-compute[74889]:       <target dev="tap0f385cdf-45"/>
Nov 10 12:24:45 user nova-compute[74889]:     </interface>
Nov 10 12:24:45 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:24:45 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/console.log" append="off"/>
Nov 10 12:24:45 user nova-compute[74889]:     </serial>
Nov 10 12:24:45 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:24:45 user nova-compute[74889]:     <video>
Nov 10 12:24:45 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:24:45 user nova-compute[74889]:     </video>
Nov 10 12:24:45 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:24:45 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:24:45 user nova-compute[74889]:     </rng>
Nov 10 12:24:45 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:24:45 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:24:45 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:24:45 user nova-compute[74889]:     </memballoon>
Nov 10 12:24:45 user nova-compute[74889]:   </devices>
Nov 10 12:24:45 user nova-compute[74889]: </domain>
Nov 10 12:24:45 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1717297090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1717297090',id=48,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-91amqoxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:23:56Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=bc9274ab-2362-42b1-a8af-06811513be55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:36:50,bridge_name='br-int',has_traffic_filtering=True,id=0f385cdf-45ca-4c25-8627-d1c23437ae5e,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f385cdf-45') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG os_vif [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:36:50,bridge_name='br-int',has_traffic_filtering=True,id=0f385cdf-45ca-4c25-8627-d1c23437ae5e,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f385cdf-45') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f9dcf2b-67ef-5c1d-b099-5530b1f5740f', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f385cdf-45, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f385cdf-45, col_values=(('qos', UUID('4de7b523-1994-4ce1-a4f7-ea8f3270fc16')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f385cdf-45, col_values=(('external_ids', {'iface-id': '0f385cdf-45ca-4c25-8627-d1c23437ae5e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:36:50', 'vm-uuid': 'bc9274ab-2362-42b1-a8af-06811513be55'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:46 user nova-compute[74889]: INFO os_vif [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:36:50,bridge_name='br-int',has_traffic_filtering=True,id=0f385cdf-45ca-4c25-8627-d1c23437ae5e,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f385cdf-45')
Nov 10 12:24:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No VIF found with MAC fa:16:3e:f2:36:50, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:46 user nova-compute[74889]: INFO nova.compute.manager [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Shelving
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-257439ef-58bc-4095-8e62-c06d297a4d6f req-922826eb-da6f-486e-8b52-83b46809eaa7 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-vif-unplugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-257439ef-58bc-4095-8e62-c06d297a4d6f req-922826eb-da6f-486e-8b52-83b46809eaa7 service nova] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-257439ef-58bc-4095-8e62-c06d297a4d6f req-922826eb-da6f-486e-8b52-83b46809eaa7 service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-257439ef-58bc-4095-8e62-c06d297a4d6f req-922826eb-da6f-486e-8b52-83b46809eaa7 service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:46 user nova-compute[74889]: DEBUG nova.compute.manager [req-257439ef-58bc-4095-8e62-c06d297a4d6f req-922826eb-da6f-486e-8b52-83b46809eaa7 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] No waiting events found dispatching network-vif-unplugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:24:46 user nova-compute[74889]: WARNING nova.compute.manager [req-257439ef-58bc-4095-8e62-c06d297a4d6f req-922826eb-da6f-486e-8b52-83b46809eaa7 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received unexpected event network-vif-unplugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f for instance with vm_state active and task_state shelving.
Nov 10 12:24:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:47 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance destroyed successfully.
Nov 10 12:24:47 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Beginning cold snapshot process
Nov 10 12:24:47 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:24:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk /opt/stack/data/nova/instances/snapshots/tmp40m1ras5/fb9efe8a475c47fa929983f9c65f0417 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:24:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:47 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk /opt/stack/data/nova/instances/snapshots/tmp40m1ras5/fb9efe8a475c47fa929983f9c65f0417" returned: 0 in 0.515s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:24:47 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Snapshot extracted, beginning image upload
Nov 10 12:24:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] No waiting events found dispatching network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:24:48 user nova-compute[74889]: WARNING nova.compute.manager [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received unexpected event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 12:24:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:24:48 user nova-compute[74889]: WARNING nova.compute.manager [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state building and task_state spawning.
Nov 10 12:24:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:24:48 user nova-compute[74889]: WARNING nova.compute.manager [req-79e0cbef-b5e2-48c6-a36d-6331a066fbff req-3b125143-5730-44ff-a662-73407bef24bc service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state building and task_state spawning.
Nov 10 12:24:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:24:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:24:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Instance spawned successfully.
Nov 10 12:24:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:24:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:24:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:24:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:24:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:24:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:24:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:24:49 user nova-compute[74889]: INFO nova.compute.manager [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 10 12:24:49 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:24:50 user nova-compute[74889]: INFO nova.compute.manager [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Took 54.92 seconds to build instance.
Nov 10 12:24:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f14a592-5bf2-4430-a0ff-781aa978755e tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "bc9274ab-2362-42b1-a8af-06811513be55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 55.035s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Snapshot image upload complete
Nov 10 12:24:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:24:50 user nova-compute[74889]: INFO nova.compute.manager [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Shelve offloading
Nov 10 12:24:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance destroyed successfully.
Nov 10 12:24:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:24:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:24:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquired lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:24:50 user nova-compute[74889]: DEBUG nova.network.neutron [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:24:50 user nova-compute[74889]: DEBUG nova.network.neutron [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating instance_info_cache with network_info: [{"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:24:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Releasing lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:51 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance destroyed successfully.
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'resources' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2053678616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2053678616',id=47,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAi+CFstq2853qShl+H0CVY3FFH6hxyBnSO7JBWtayf1NbcqqH38RXu0/Qh13T/4HP2p50UEbiVYZgFUY3XwtK169awAETyoIQGYPwXHbsYMu3PdwGMCB3LdMdrAyr9s7A==',key_name='tempest-keypair-1550139395',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:22:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-bw70m0dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member',shelved_at='2023-11-10T12:24:50.169682',shelved_host='user',shelved_image_id='5cd44024-2658-44ed-8c3c-26543f8ec6c4'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=73d95044-495c-4254-b14b-3a02c1c1dfd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG os_vif [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb76e6a59-56, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7bc340c-deee-4e27-bce6-c98ad636fc1d) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-3e280b4e-5678-4c4d-96ce-6cb0de1424d6 req-6d827de5-ed39-49a8-9e51-f1cbc49f354e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-changed-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-3e280b4e-5678-4c4d-96ce-6cb0de1424d6 req-6d827de5-ed39-49a8-9e51-f1cbc49f354e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Refreshing instance network info cache due to event network-changed-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3e280b4e-5678-4c4d-96ce-6cb0de1424d6 req-6d827de5-ed39-49a8-9e51-f1cbc49f354e service nova] Acquiring lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3e280b4e-5678-4c4d-96ce-6cb0de1424d6 req-6d827de5-ed39-49a8-9e51-f1cbc49f354e service nova] Acquired lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-3e280b4e-5678-4c4d-96ce-6cb0de1424d6 req-6d827de5-ed39-49a8-9e51-f1cbc49f354e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Refreshing network info cache for port b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:24:51 user nova-compute[74889]: INFO os_vif [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56')
Nov 10 12:24:51 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Deleting instance files /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8_del
Nov 10 12:24:51 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Deletion of /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8_del complete
Nov 10 12:24:51 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Deleted allocations for instance 73d95044-495c-4254-b14b-3a02c1c1dfd8
Nov 10 12:24:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'numa_topology' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.objects.base [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Object Instance<73d95044-495c-4254-b14b-3a02c1c1dfd8> lazy-loaded attributes: resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-3e280b4e-5678-4c4d-96ce-6cb0de1424d6 req-6d827de5-ed39-49a8-9e51-f1cbc49f354e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updated VIF entry in instance network info cache for port b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-3e280b4e-5678-4c4d-96ce-6cb0de1424d6 req-6d827de5-ed39-49a8-9e51-f1cbc49f354e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating instance_info_cache with network_info: [{"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb76e6a59-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3e280b4e-5678-4c4d-96ce-6cb0de1424d6 req-6d827de5-ed39-49a8-9e51-f1cbc49f354e service nova] Releasing lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f9f7f376-f618-4ea0-a68c-3544c78bada2 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.688s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:24:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:24:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:03 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:25:03 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8279MB free_disk=24.968143463134766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance bc9274ab-2362-42b1-a8af-06811513be55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:25:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:25:04 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:25:04 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:25:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:25:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:25:04 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:25:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:05 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updating instance_info_cache with network_info: [{"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:25:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-7f361287-3a8c-4422-992d-709d48c7c663" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:25:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:25:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:25:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:25:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:25:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:25:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVAcDrEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:25:07 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:25:07 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:25:07 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02a0fc6-5bf0-4645-a6c2-ac7a751e3dc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:25:07 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd534cb1-6451-4907-9352-91548ea991ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0] added
Nov 10 12:25:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2940f7-f1b9-4804-9939-ab62c03fb2ce]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4fcc10-39e5-49da-b154-b7b3cf982ced]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vVAcDrEB {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vVAcDrEB" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c2b62b-5b75-442e-9510-af2c06238635]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vVAcDrEB'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[24afadc1-0396-4fca-8c40-6b1e8a64f985]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c329d7f-e5c2-42fa-9bd3-168e3d0c0629]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:25:07 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:25:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:25:07 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:25:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c14a29-5aa9-46c7-a61f-5b8fc15bb043]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0, portal: 172.16.0.220,3260]
Nov 10 12:25:07 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0, portal: 172.16.0.220,3260] successful.
Nov 10 12:25:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c607b87c-a8ef-44ee-b33a-0948c2bbe020]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e8d242-8ccd-4177-a018-821c2cb46707]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:25:07 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:25:07 user nova-compute[74889]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 (non-flash)
Nov 10 12:25:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:25:07 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:25:07 user nova-compute[74889]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 (non-flash)
Nov 10 12:25:07 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[756583b1-7523-406a-b2ef-012143548cf5]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:25:07 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:25:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:25:08 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:25:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVAcDrEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:25:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:25:08 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26463653265643863', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:25:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463653265643863', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:25:08 user nova-compute[74889]: DEBUG nova.objects.instance [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:25:08 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:25:08 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:25:08 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:25:08 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:25:08 user nova-compute[74889]:   <serial>5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0</serial>
Nov 10 12:25:08 user nova-compute[74889]: </disk>
Nov 10 12:25:08 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:25:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:25:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:25:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No VIF found with MAC fa:16:3e:bc:b5:4d, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:25:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b93b4a4e-8df3-4067-9f12-cc488134f0f7 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.124s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:25:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:25:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:25:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:25:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:22 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:25:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:25:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:25:23 user nova-compute[74889]: DEBUG nova.compute.manager [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:25:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:25:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:25:23 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:25:23 user nova-compute[74889]: INFO nova.compute.claims [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Claim successful on node user
Nov 10 12:25:23 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:25:23 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:25:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:25:23 user nova-compute[74889]: DEBUG nova.compute.manager [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.network.neutron [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:25:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.policy [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db6e671b33f14840b2a79a3affbbaaa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c4b9efdfb14eadb63b747cc3c6003f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:25:24 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Creating image(s)
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.193s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.166s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk 1073741824" returned: 0 in 0.052s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.network.neutron [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Successfully created port: 986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Cannot resize image /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Ensure instance console log exists: /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:25:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.network.neutron [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Successfully updated port: 986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquired lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.network.neutron [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-bb240a71-9171-4832-8d6d-47a9c33ebe0c req-bd1e74a9-e3cb-495c-99fc-0b3889f5d71c service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-changed-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-bb240a71-9171-4832-8d6d-47a9c33ebe0c req-bd1e74a9-e3cb-495c-99fc-0b3889f5d71c service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Refreshing instance network info cache due to event network-changed-986baf45-7347-40ae-81d3-a36a1fd1eb55. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bb240a71-9171-4832-8d6d-47a9c33ebe0c req-bd1e74a9-e3cb-495c-99fc-0b3889f5d71c service nova] Acquiring lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.network.neutron [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.network.neutron [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updating instance_info_cache with network_info: [{"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Releasing lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Instance network_info: |[{"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bb240a71-9171-4832-8d6d-47a9c33ebe0c req-bd1e74a9-e3cb-495c-99fc-0b3889f5d71c service nova] Acquired lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.network.neutron [req-bb240a71-9171-4832-8d6d-47a9c33ebe0c req-bd1e74a9-e3cb-495c-99fc-0b3889f5d71c service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Refreshing network info cache for port 986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Start _get_guest_xml network_info=[{"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:25:25 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:25:25 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:25:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2118297203',display_name='tempest-ServerRescueNegativeTestJSON-server-2118297203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2118297203',id=49,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8JrWJfsnCMq/p+fZnn0MmDRW/cQ2ks9/NQlTsYsc3MwL6GMJYodz/XgnmHBD9v23FxsV+LGd8yLrA9FsiMiAELpz7414q/TrallGPqcEt5fwkwwiQTUFAlB12DIkq1aw==',key_name='tempest-keypair-676962485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-zzkqnust',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:25:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=2d444297-e40e-4030-90a7-b934eda6fbb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ba:c5,bridge_name='br-int',has_traffic_filtering=True,id=986baf45-7347-40ae-81d3-a36a1fd1eb55,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986baf45-73') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.objects.instance [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:25:25 user nova-compute[74889]:   <uuid>2d444297-e40e-4030-90a7-b934eda6fbb6</uuid>
Nov 10 12:25:25 user nova-compute[74889]:   <name>instance-00000031</name>
Nov 10 12:25:25 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:25:25 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:25:25 user nova-compute[74889]:   <metadata>
Nov 10 12:25:25 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:25:25 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:25:25 user nova-compute[74889]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2118297203</nova:name>
Nov 10 12:25:25 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:25:25</nova:creationTime>
Nov 10 12:25:25 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:25:25 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:25:25 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:25:25 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:25:25 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:25:25 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:25:25 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:25:25 user nova-compute[74889]:       <nova:owner>
Nov 10 12:25:25 user nova-compute[74889]:         <nova:user uuid="db6e671b33f14840b2a79a3affbbaaa8">tempest-ServerRescueNegativeTestJSON-524488673-project-member</nova:user>
Nov 10 12:25:25 user nova-compute[74889]:         <nova:project uuid="62c4b9efdfb14eadb63b747cc3c6003f">tempest-ServerRescueNegativeTestJSON-524488673</nova:project>
Nov 10 12:25:25 user nova-compute[74889]:       </nova:owner>
Nov 10 12:25:25 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:25:25 user nova-compute[74889]:       <nova:ports>
Nov 10 12:25:25 user nova-compute[74889]:         <nova:port uuid="986baf45-7347-40ae-81d3-a36a1fd1eb55">
Nov 10 12:25:25 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:25:25 user nova-compute[74889]:         </nova:port>
Nov 10 12:25:25 user nova-compute[74889]:       </nova:ports>
Nov 10 12:25:25 user nova-compute[74889]:     </nova:instance>
Nov 10 12:25:25 user nova-compute[74889]:   </metadata>
Nov 10 12:25:25 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:25:25 user nova-compute[74889]:     <system>
Nov 10 12:25:25 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:25:25 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:25:25 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:25:25 user nova-compute[74889]:       <entry name="serial">2d444297-e40e-4030-90a7-b934eda6fbb6</entry>
Nov 10 12:25:25 user nova-compute[74889]:       <entry name="uuid">2d444297-e40e-4030-90a7-b934eda6fbb6</entry>
Nov 10 12:25:25 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:25:25 user nova-compute[74889]:     </system>
Nov 10 12:25:25 user nova-compute[74889]:   </sysinfo>
Nov 10 12:25:25 user nova-compute[74889]:   <os>
Nov 10 12:25:25 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:25:25 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:25:25 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:25:25 user nova-compute[74889]:   </os>
Nov 10 12:25:25 user nova-compute[74889]:   <features>
Nov 10 12:25:25 user nova-compute[74889]:     <acpi/>
Nov 10 12:25:25 user nova-compute[74889]:     <apic/>
Nov 10 12:25:25 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:25:25 user nova-compute[74889]:   </features>
Nov 10 12:25:25 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:25:25 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:25:25 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:25:25 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:25:25 user nova-compute[74889]:   </clock>
Nov 10 12:25:25 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:25:25 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:25:25 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:25:25 user nova-compute[74889]:   </cpu>
Nov 10 12:25:25 user nova-compute[74889]:   <devices>
Nov 10 12:25:25 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:25:25 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:25:25 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk"/>
Nov 10 12:25:25 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:25:25 user nova-compute[74889]:     </disk>
Nov 10 12:25:25 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:25:25 user nova-compute[74889]:       <mac address="fa:16:3e:dd:ba:c5"/>
Nov 10 12:25:25 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:25:25 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:25:25 user nova-compute[74889]:       <target dev="tap986baf45-73"/>
Nov 10 12:25:25 user nova-compute[74889]:     </interface>
Nov 10 12:25:25 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:25:25 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/console.log" append="off"/>
Nov 10 12:25:25 user nova-compute[74889]:     </serial>
Nov 10 12:25:25 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:25:25 user nova-compute[74889]:     <video>
Nov 10 12:25:25 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:25:25 user nova-compute[74889]:     </video>
Nov 10 12:25:25 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:25:25 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:25:25 user nova-compute[74889]:     </rng>
Nov 10 12:25:25 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:25:25 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:25:25 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:25:25 user nova-compute[74889]:     </memballoon>
Nov 10 12:25:25 user nova-compute[74889]:   </devices>
Nov 10 12:25:25 user nova-compute[74889]: </domain>
Nov 10 12:25:25 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:25:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2118297203',display_name='tempest-ServerRescueNegativeTestJSON-server-2118297203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2118297203',id=49,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8JrWJfsnCMq/p+fZnn0MmDRW/cQ2ks9/NQlTsYsc3MwL6GMJYodz/XgnmHBD9v23FxsV+LGd8yLrA9FsiMiAELpz7414q/TrallGPqcEt5fwkwwiQTUFAlB12DIkq1aw==',key_name='tempest-keypair-676962485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-zzkqnust',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:25:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=2d444297-e40e-4030-90a7-b934eda6fbb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ba:c5,bridge_name='br-int',has_traffic_filtering=True,id=986baf45-7347-40ae-81d3-a36a1fd1eb55,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986baf45-73') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG os_vif [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ba:c5,bridge_name='br-int',has_traffic_filtering=True,id=986baf45-7347-40ae-81d3-a36a1fd1eb55,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986baf45-73') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49b10854-59e8-5906-a50c-2daab7ef4c14', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap986baf45-73, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap986baf45-73, col_values=(('qos', UUID('3926dcb1-b4c1-4e81-a20a-38545807b74b')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap986baf45-73, col_values=(('external_ids', {'iface-id': '986baf45-7347-40ae-81d3-a36a1fd1eb55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:ba:c5', 'vm-uuid': '2d444297-e40e-4030-90a7-b934eda6fbb6'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:25 user nova-compute[74889]: INFO os_vif [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:ba:c5,bridge_name='br-int',has_traffic_filtering=True,id=986baf45-7347-40ae-81d3-a36a1fd1eb55,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986baf45-73')
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:25:25 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No VIF found with MAC fa:16:3e:dd:ba:c5, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:25:26 user nova-compute[74889]: DEBUG nova.network.neutron [req-bb240a71-9171-4832-8d6d-47a9c33ebe0c req-bd1e74a9-e3cb-495c-99fc-0b3889f5d71c service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updated VIF entry in instance network info cache for port 986baf45-7347-40ae-81d3-a36a1fd1eb55. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:25:26 user nova-compute[74889]: DEBUG nova.network.neutron [req-bb240a71-9171-4832-8d6d-47a9c33ebe0c req-bd1e74a9-e3cb-495c-99fc-0b3889f5d71c service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updating instance_info_cache with network_info: [{"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:25:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bb240a71-9171-4832-8d6d-47a9c33ebe0c req-bd1e74a9-e3cb-495c-99fc-0b3889f5d71c service nova] Releasing lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:25:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-a8a47178-2cb9-46e6-b122-1d0c3e92f65a req-a7c03bd6-d4fb-43b8-afd1-4c97682007dc service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:25:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a8a47178-2cb9-46e6-b122-1d0c3e92f65a req-a7c03bd6-d4fb-43b8-afd1-4c97682007dc service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:25:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a8a47178-2cb9-46e6-b122-1d0c3e92f65a req-a7c03bd6-d4fb-43b8-afd1-4c97682007dc service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:25:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a8a47178-2cb9-46e6-b122-1d0c3e92f65a req-a7c03bd6-d4fb-43b8-afd1-4c97682007dc service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:25:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-a8a47178-2cb9-46e6-b122-1d0c3e92f65a req-a7c03bd6-d4fb-43b8-afd1-4c97682007dc service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:25:27 user nova-compute[74889]: WARNING nova.compute.manager [req-a8a47178-2cb9-46e6-b122-1d0c3e92f65a req-a7c03bd6-d4fb-43b8-afd1-4c97682007dc service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state building and task_state spawning.
Nov 10 12:25:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:25:29 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Instance spawned successfully.
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:25:29 user nova-compute[74889]: INFO nova.compute.manager [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-b5122ffa-7ce7-4a7e-b7f2-551bdeeb6696 req-9791a701-7bea-44a7-8b6a-921b564e5e10 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b5122ffa-7ce7-4a7e-b7f2-551bdeeb6696 req-9791a701-7bea-44a7-8b6a-921b564e5e10 service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b5122ffa-7ce7-4a7e-b7f2-551bdeeb6696 req-9791a701-7bea-44a7-8b6a-921b564e5e10 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b5122ffa-7ce7-4a7e-b7f2-551bdeeb6696 req-9791a701-7bea-44a7-8b6a-921b564e5e10 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:25:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-b5122ffa-7ce7-4a7e-b7f2-551bdeeb6696 req-9791a701-7bea-44a7-8b6a-921b564e5e10 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:25:29 user nova-compute[74889]: WARNING nova.compute.manager [req-b5122ffa-7ce7-4a7e-b7f2-551bdeeb6696 req-9791a701-7bea-44a7-8b6a-921b564e5e10 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state building and task_state spawning.
Nov 10 12:25:29 user nova-compute[74889]: INFO nova.compute.manager [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Took 6.06 seconds to build instance.
Nov 10 12:25:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-2c333c75-b35b-4704-860e-a6e6696f17af tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.169s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:25:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:25:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:25:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:25:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:25:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:25:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:25:49 user nova-compute[74889]: INFO nova.compute.manager [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Detaching volume 5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0
Nov 10 12:25:49 user nova-compute[74889]: INFO nova.virt.block_device [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attempting to driver detach volume 5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 from mountpoint /dev/vdb
Nov 10 12:25:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Attempting to detach device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:25:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:25:49 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:25:49 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:25:49 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:25:49 user nova-compute[74889]:   <serial>5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0</serial>
Nov 10 12:25:49 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:25:49 user nova-compute[74889]: </disk>
Nov 10 12:25:49 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:25:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Successfully detached device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the persistent domain config.
Nov 10 12:25:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:25:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:25:49 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:25:49 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:25:49 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:25:49 user nova-compute[74889]:   <serial>5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0</serial>
Nov 10 12:25:49 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:25:49 user nova-compute[74889]: </disk>
Nov 10 12:25:49 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:25:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:25:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:25:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:26:01 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:02 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:26:04 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8221MB free_disk=24.937625885009766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance bc9274ab-2362-42b1-a8af-06811513be55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 2d444297-e40e-4030-90a7-b934eda6fbb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:26:04 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:26:05 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:26:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updating instance_info_cache with network_info: [{"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:26:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:26:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:26:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:26:09 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d58137e4-403b-45af-b9fc-64a2c5efe819 is timed out.
Nov 10 12:26:09 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Successfully detached device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the live domain config.
Nov 10 12:26:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:26:09 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vVAcDrEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:26:10 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da9d16d-6732-420f-aecb-580d16b3eb16]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:26:10 user nova-compute[74889]: No targets found.
Nov 10 12:26:10 user nova-compute[74889]: iSNS:
Nov 10 12:26:10 user nova-compute[74889]: No targets found.
Nov 10 12:26:10 user nova-compute[74889]: STATIC:
Nov 10 12:26:10 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273
Nov 10 12:26:10 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:26:10 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:26:10 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:26:10 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:26:10 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:26:10 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0
Nov 10 12:26:10 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:26:10 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:26:10 user nova-compute[74889]: FIRMWARE:
Nov 10 12:26:10 user nova-compute[74889]: No targets found.
Nov 10 12:26:10 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:26:10 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:26:10 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8c1eb0-2646-4a36-88d9-ae8a8c92cf49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69c5bad-941d-43da-be33-10c1cf5e266f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:26:10 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:26:10 user nova-compute[74889]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 (non-flash)
Nov 10 12:26:10 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:26:10 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:26:10 user nova-compute[74889]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 (non-flash)
Nov 10 12:26:10 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a0110670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5432bc-b773-47ca-8e66-583767babd8e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dc5246-91e8-49bb-baad-7e3c96d4c9c0]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e194f2-ad23-458f-898a-c499b5403376]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e249f1f7-f000-44dd-ab2a-7c2dbd6c0e75]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff6d691-60d2-4024-b199-f0a96e39274a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[594cdc46-3041-4615-a532-5b7a9ac64bce]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0, portal: 172.16.0.220,3260]
Nov 10 12:26:10 user nova-compute[74889]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0, portal: 172.16.0.220,3260] successful.
Nov 10 12:26:10 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f5d8fcc-79a6-4544-b4a1-60a250e7e2c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[49353388-3102-4f3b-b8dd-600da019b9c4]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== disconnect_volume: return (318ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:26:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:11 user nova-compute[74889]: DEBUG nova.objects.instance [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:26:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3485b99e-4645-4766-92e9-ad27455b8fe9 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.877s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:26:17 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:26:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:26:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:26:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:26:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:26:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:26:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:26:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:26:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Verify base images {{(pid=74889) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Image id b0074759-91cd-4b7c-8386-071a17ff617a yields fingerprint 3e6199bea6321b2237bf0bf96db3a9874bf00c7a {{(pid=74889) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 12:26:29 user nova-compute[74889]: INFO nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] image b0074759-91cd-4b7c-8386-071a17ff617a at (/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a): checking
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] image b0074759-91cd-4b7c-8386-071a17ff617a at (/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a): image is in use {{(pid=74889) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74889) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] 2d444297-e40e-4030-90a7-b934eda6fbb6 is a valid instance name {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] 2d444297-e40e-4030-90a7-b934eda6fbb6 has a disk file {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 2d444297-e40e-4030-90a7-b934eda6fbb6 is backed by 3e6199bea6321b2237bf0bf96db3a9874bf00c7a {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] 662a3c8c-e0b0-4dea-b620-d11de1c5a92e is a valid instance name {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] 662a3c8c-e0b0-4dea-b620-d11de1c5a92e has a disk file {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e is backed by 3e6199bea6321b2237bf0bf96db3a9874bf00c7a {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] 7f361287-3a8c-4422-992d-709d48c7c663 is a valid instance name {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] d58137e4-403b-45af-b9fc-64a2c5efe819 is a valid instance name {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] d58137e4-403b-45af-b9fc-64a2c5efe819 has a disk file {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 is backed by 3e6199bea6321b2237bf0bf96db3a9874bf00c7a {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] 990a099a-7893-4428-9de1-8dc217bf2fc0 is a valid instance name {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] 990a099a-7893-4428-9de1-8dc217bf2fc0 has a disk file {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 12:26:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 is backed by 3e6199bea6321b2237bf0bf96db3a9874bf00c7a {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] 3824b4fa-25e2-436d-87d8-762353765644 is a valid instance name {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] 3824b4fa-25e2-436d-87d8-762353765644 has a disk file {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 is backed by 3e6199bea6321b2237bf0bf96db3a9874bf00c7a {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] de32b888-15ed-42eb-9029-1cb3dc471253 is a valid instance name {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] de32b888-15ed-42eb-9029-1cb3dc471253 has a disk file {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 is backed by 3e6199bea6321b2237bf0bf96db3a9874bf00c7a {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] bc9274ab-2362-42b1-a8af-06811513be55 is a valid instance name {{(pid=74889) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 12:26:30 user nova-compute[74889]: WARNING nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Unknown base file: /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7
Nov 10 12:26:30 user nova-compute[74889]: WARNING nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Unknown base file: /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c
Nov 10 12:26:30 user nova-compute[74889]: WARNING nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Unknown base file: /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06
Nov 10 12:26:30 user nova-compute[74889]: WARNING nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Unknown base file: /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74
Nov 10 12:26:30 user nova-compute[74889]: WARNING nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Unknown base file: /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65
Nov 10 12:26:30 user nova-compute[74889]: WARNING nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Unknown base file: /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2
Nov 10 12:26:30 user nova-compute[74889]: INFO nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Active base files: /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a
Nov 10 12:26:30 user nova-compute[74889]: INFO nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Removable base files: /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7 /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06 /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74 /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65 /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2
Nov 10 12:26:30 user nova-compute[74889]: INFO nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/427d78cb05e9acb28003b4a22b63c2469e42fdf7
Nov 10 12:26:30 user nova-compute[74889]: INFO nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/10776148a73a31b4f4592cc4b110815cb0a4de2c
Nov 10 12:26:30 user nova-compute[74889]: INFO nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b1a121809d94d91e81c6dc9036889af227e00e06
Nov 10 12:26:30 user nova-compute[74889]: INFO nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d44530cff28efa79056b97404f2fcc033fb80b74
Nov 10 12:26:30 user nova-compute[74889]: INFO nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9e1f686e456745fe3d0cbc411c67ce5062825b65
Nov 10 12:26:30 user nova-compute[74889]: INFO nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/540210a18e215cf21650e413ca360bd1703e05e2
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Verification complete {{(pid=74889) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Verify swap images {{(pid=74889) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.imagecache [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Verify ephemeral images {{(pid=74889) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 10 12:26:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:26:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:36 user nova-compute[74889]: INFO nova.compute.manager [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Rescuing
Nov 10 12:26:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquired lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG nova.network.neutron [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG nova.network.neutron [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Updating instance_info_cache with network_info: [{"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Releasing lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-89fcbaf3-7017-408d-8036-571853b901c7 req-831e00ce-1712-48e5-be95-b64b8e01581b service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-89fcbaf3-7017-408d-8036-571853b901c7 req-831e00ce-1712-48e5-be95-b64b8e01581b service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-89fcbaf3-7017-408d-8036-571853b901c7 req-831e00ce-1712-48e5-be95-b64b8e01581b service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-89fcbaf3-7017-408d-8036-571853b901c7 req-831e00ce-1712-48e5-be95-b64b8e01581b service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-89fcbaf3-7017-408d-8036-571853b901c7 req-831e00ce-1712-48e5-be95-b64b8e01581b service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:26:36 user nova-compute[74889]: WARNING nova.compute.manager [req-89fcbaf3-7017-408d-8036-571853b901c7 req-831e00ce-1712-48e5-be95-b64b8e01581b service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state active and task_state rescuing.
Nov 10 12:26:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Instance destroyed successfully.
Nov 10 12:26:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Attempting a stable device rescue
Nov 10 12:26:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74889) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 12:26:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Instance directory exists: not creating {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 12:26:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Creating image(s)
Nov 10 12:26:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "/opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "/opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:37 user nova-compute[74889]: DEBUG nova.objects.instance [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'trusted_certs' on Instance uuid bc9274ab-2362-42b1-a8af-06811513be55 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:26:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "ace716e7b0d5680a5ff22d2be29dfad4d47aa87c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "ace716e7b0d5680a5ff22d2be29dfad4d47aa87c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c.part --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:38 user nova-compute[74889]: INFO nova.compute.manager [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Unshelving
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG nova.virt.images [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] ab571087-e81f-46b6-a084-f8f3f1a327b5 was qcow2, converting to raw {{(pid=74889) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c.part /opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c.converted {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:38 user nova-compute[74889]: INFO nova.virt.block_device [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Booting with volume 3e67a8f1-130f-462b-8577-24f3c761ce76 at /dev/vdc
Nov 10 12:26:38 user nova-compute[74889]: DEBUG os_brick.utils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b98ad9-aa11-428c-812b-d02650f7f376]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd65996f-02b1-422c-b66c-6b3b6e1fdacf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7c5ad8-5a0f-4482-9365-083deff3f2a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e3c71a-beb7-4aa4-8d79-5d3837662031]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-6930ab1c-87d5-41e5-80d7-17a8bea6cc9f req-98b038a8-bbe9-4eac-96ac-90a069560857 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6930ab1c-87d5-41e5-80d7-17a8bea6cc9f req-98b038a8-bbe9-4eac-96ac-90a069560857 service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6930ab1c-87d5-41e5-80d7-17a8bea6cc9f req-98b038a8-bbe9-4eac-96ac-90a069560857 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6930ab1c-87d5-41e5-80d7-17a8bea6cc9f req-98b038a8-bbe9-4eac-96ac-90a069560857 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-6930ab1c-87d5-41e5-80d7-17a8bea6cc9f req-98b038a8-bbe9-4eac-96ac-90a069560857 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:26:38 user nova-compute[74889]: WARNING nova.compute.manager [req-6930ab1c-87d5-41e5-80d7-17a8bea6cc9f req-98b038a8-bbe9-4eac-96ac-90a069560857 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state active and task_state rescuing.
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:26:38 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:26:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eb30f3-fa5e-4b47-83b3-8d2adcb326eb]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG os_brick.utils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:26:38 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating existing volume attachment record: 29644ee4-e9c4-4728-b544-672802f82028 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c.part /opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c.converted" returned: 0 in 0.539s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c.converted --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "ace716e7b0d5680a5ff22d2be29dfad4d47aa87c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.966s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "ace716e7b0d5680a5ff22d2be29dfad4d47aa87c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "ace716e7b0d5680a5ff22d2be29dfad4d47aa87c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c --force-share --output=json" returned: 0 in 0.194s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c,backing_fmt=raw /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ace716e7b0d5680a5ff22d2be29dfad4d47aa87c,backing_fmt=raw /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue" returned: 0 in 0.053s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "ace716e7b0d5680a5ff22d2be29dfad4d47aa87c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'migration_context' on Instance uuid bc9274ab-2362-42b1-a8af-06811513be55 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.objects.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Object Instance<bc9274ab-2362-42b1-a8af-06811513be55> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Start _get_guest_xml network_info=[{"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "vif_mac": "fa:16:3e:f2:36:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ab571087-e81f-46b6-a084-f8f3f1a327b5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnmorNbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'bc9274ab-2362-42b1-a8af-06811513be55', 'attached_at': '', 'detached_at': '', 'volume_id': '41f28e7d-9fa0-41a9-931a-42cdbb823273', 'serial': '41f28e7d-9fa0-41a9-931a-42cdbb823273'}, 'disk_bus': 'virtio', 'attachment_id': '841c20f1-e9e7-4970-bb3e-5c7e3d0ae0ad', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'resources' on Instance uuid bc9274ab-2362-42b1-a8af-06811513be55 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.objects.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Object Instance<bc9274ab-2362-42b1-a8af-06811513be55> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'numa_topology' on Instance uuid bc9274ab-2362-42b1-a8af-06811513be55 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.objects.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Object Instance<bc9274ab-2362-42b1-a8af-06811513be55> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:26:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:26:39 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc9274ab-2362-42b1-a8af-06811513be55 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.objects.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Object Instance<bc9274ab-2362-42b1-a8af-06811513be55> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnmorNbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:26:39 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:26:39 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:26:39 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6b68c1-d9c0-477a-abe7-a63d3437bcd2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cnmorNbT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 12:26:39 user nova-compute[74889]: node.name = iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273
Nov 10 12:26:39 user nova-compute[74889]: node.tpgt = -1
Nov 10 12:26:39 user nova-compute[74889]: node.startup = automatic
Nov 10 12:26:39 user nova-compute[74889]: node.leading_login = No
Nov 10 12:26:39 user nova-compute[74889]: iface.iscsi_ifacename = default
Nov 10 12:26:39 user nova-compute[74889]: iface.net_ifacename = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.ipaddress = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.prefix_len = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.hwaddress = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.transport_name = tcp
Nov 10 12:26:39 user nova-compute[74889]: iface.initiatorname = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.state = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.vlan_id = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.vlan_priority = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.vlan_state = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.iface_num = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.mtu = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.port = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.bootproto = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.subnet_mask = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.gateway = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.dhcp_alt_client_id = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.dhcp_dns = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.dhcp_learn_iqn = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.dhcp_vendor_id_state = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.dhcp_vendor_id = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.dhcp_slp_da = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.fragmentation = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.gratuitous_arp = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.incoming_forwarding = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.tos_state = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.tos = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.ttl = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.delayed_ack = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.tcp_nagle = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.tcp_wsf_state = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.tcp_wsf = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.tcp_timer_scale = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.tcp_timestamp = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.redirect = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.def_task_mgmt_timeout = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.header_digest = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.data_digest = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.immediate_data = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.initial_r2t = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.data_seq_inorder = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.data_pdu_inorder = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.erl = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.max_receive_data_len = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.first_burst_len = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.max_outstanding_r2t = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.max_burst_len = 0
Nov 10 12:26:39 user nova-compute[74889]: iface.chap_auth = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.bidi_chap = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.strict_login_compliance = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.discovery_auth = <empty>
Nov 10 12:26:39 user nova-compute[74889]: iface.discovery_logout = <empty>
Nov 10 12:26:39 user nova-compute[74889]: node.discovery_address = <empty>
Nov 10 12:26:39 user nova-compute[74889]: node.discovery_port = 0
Nov 10 12:26:39 user nova-compute[74889]: node.discovery_type = static
Nov 10 12:26:39 user nova-compute[74889]: node.session.initial_cmdsn = 0
Nov 10 12:26:39 user nova-compute[74889]: node.session.initial_login_retry_max = 8
Nov 10 12:26:39 user nova-compute[74889]: node.session.xmit_thread_priority = -20
Nov 10 12:26:39 user nova-compute[74889]: node.session.cmds_max = 128
Nov 10 12:26:39 user nova-compute[74889]: node.session.queue_depth = 32
Nov 10 12:26:39 user nova-compute[74889]: node.session.nr_sessions = 1
Nov 10 12:26:39 user nova-compute[74889]: node.session.auth.authmethod = CHAP
Nov 10 12:26:39 user nova-compute[74889]: node.session.auth.username = cnmorNbT
Nov 10 12:26:39 user nova-compute[74889]: node.session.auth.password = ***
Nov 10 12:26:39 user nova-compute[74889]: node.session.auth.username_in = <empty>
Nov 10 12:26:39 user nova-compute[74889]: node.session.auth.password_in = <empty>
Nov 10 12:26:39 user nova-compute[74889]: node.session.auth.chap_algs = MD5
Nov 10 12:26:39 user nova-compute[74889]: node.session.timeo.replacement_timeout = 120
Nov 10 12:26:39 user nova-compute[74889]: node.session.err_timeo.abort_timeout = 15
Nov 10 12:26:39 user nova-compute[74889]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 12:26:39 user nova-compute[74889]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 12:26:39 user nova-compute[74889]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 12:26:39 user nova-compute[74889]: node.session.iscsi.FastAbort = Yes
Nov 10 12:26:39 user nova-compute[74889]: node.session.iscsi.InitialR2T = No
Nov 10 12:26:39 user nova-compute[74889]: node.session.iscsi.ImmediateData = Yes
Nov 10 12:26:39 user nova-compute[74889]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 12:26:39 user nova-compute[74889]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 12:26:39 user nova-compute[74889]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 12:26:39 user nova-compute[74889]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 12:26:39 user nova-compute[74889]: node.session.iscsi.MaxConnections = 1
Nov 10 12:26:39 user nova-compute[74889]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 12:26:39 user nova-compute[74889]: node.session.iscsi.ERL = 0
Nov 10 12:26:39 user nova-compute[74889]: node.session.scan = manual
Nov 10 12:26:39 user nova-compute[74889]: node.session.reopen_max = 0
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].address = 172.16.0.220
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].port = 3260
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].startup = manual
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].tcp.window_size = 524288
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].tcp.type_of_service = 0
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].timeo.logout_timeout = 15
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].timeo.login_timeout = 15
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].timeo.auth_timeout = 45
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].iscsi.DataDigest = None
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].iscsi.IFMarker = No
Nov 10 12:26:39 user nova-compute[74889]: node.conn[0].iscsi.OFMarker = No
Nov 10 12:26:39 user nova-compute[74889]: # END RECORD
Nov 10 12:26:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2674be15-1374-4c8f-b646-8d7567c50964]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf4a409-ecb7-47c5-8b6c-41001e9fb192]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnmorNbT {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnmorNbT" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbbffd4-6f89-4431-968c-0bf1246fd500]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cnmorNbT'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f48143e-4cb4-481c-b025-c8f5e05b4009]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca8e7d6-9f06-4b06-bb0d-a10d7304ae7e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:26:39 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:26:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:26:39 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:26:39 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.224s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:26:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] HCTL ('34', '0', '0', 0) found on session 50 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[892c5471-5d78-43d0-9272-1e6e647208c9]: (4, ('0 0 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Searching for a device in session 50 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnmorNbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.249s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] <== connect_volume: return (250ms) {'type': 'block', 'scsi_wwn': '26136656433623132', 'path': '/dev/sdc'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136656433623132', 'path': '/dev/sdc'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1717297090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1717297090',id=48,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:24:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-91amqoxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:24:50Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=bc9274ab-2362-42b1-a8af-06811513be55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "vif_mac": "fa:16:3e:f2:36:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "vif_mac": "fa:16:3e:f2:36:50"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:36:50,bridge_name='br-int',has_traffic_filtering=True,id=0f385cdf-45ca-4c25-8627-d1c23437ae5e,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f385cdf-45') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG nova.objects.instance [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'pci_devices' on Instance uuid bc9274ab-2362-42b1-a8af-06811513be55 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG nova.objects.base [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Object Instance<bc9274ab-2362-42b1-a8af-06811513be55> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:26:40 user nova-compute[74889]:   <uuid>bc9274ab-2362-42b1-a8af-06811513be55</uuid>
Nov 10 12:26:40 user nova-compute[74889]:   <name>instance-00000030</name>
Nov 10 12:26:40 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:26:40 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:26:40 user nova-compute[74889]:   <metadata>
Nov 10 12:26:40 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:26:40 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:26:40 user nova-compute[74889]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1717297090</nova:name>
Nov 10 12:26:40 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:26:39</nova:creationTime>
Nov 10 12:26:40 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:26:40 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:26:40 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:26:40 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:26:40 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:26:40 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:26:40 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:26:40 user nova-compute[74889]:       <nova:owner>
Nov 10 12:26:40 user nova-compute[74889]:         <nova:user uuid="4c2a48cfc9e04a2dbd2ad51b70c8b114">tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member</nova:user>
Nov 10 12:26:40 user nova-compute[74889]:         <nova:project uuid="757eef88e9c04404a1ddedfa23b6031d">tempest-ServerBootFromVolumeStableRescueTest-1484079705</nova:project>
Nov 10 12:26:40 user nova-compute[74889]:       </nova:owner>
Nov 10 12:26:40 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:26:40 user nova-compute[74889]:       <nova:ports>
Nov 10 12:26:40 user nova-compute[74889]:         <nova:port uuid="0f385cdf-45ca-4c25-8627-d1c23437ae5e">
Nov 10 12:26:40 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 12:26:40 user nova-compute[74889]:         </nova:port>
Nov 10 12:26:40 user nova-compute[74889]:       </nova:ports>
Nov 10 12:26:40 user nova-compute[74889]:     </nova:instance>
Nov 10 12:26:40 user nova-compute[74889]:   </metadata>
Nov 10 12:26:40 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:26:40 user nova-compute[74889]:     <system>
Nov 10 12:26:40 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:26:40 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:26:40 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:26:40 user nova-compute[74889]:       <entry name="serial">bc9274ab-2362-42b1-a8af-06811513be55</entry>
Nov 10 12:26:40 user nova-compute[74889]:       <entry name="uuid">bc9274ab-2362-42b1-a8af-06811513be55</entry>
Nov 10 12:26:40 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:26:40 user nova-compute[74889]:     </system>
Nov 10 12:26:40 user nova-compute[74889]:   </sysinfo>
Nov 10 12:26:40 user nova-compute[74889]:   <os>
Nov 10 12:26:40 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:26:40 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:26:40 user nova-compute[74889]:   </os>
Nov 10 12:26:40 user nova-compute[74889]:   <features>
Nov 10 12:26:40 user nova-compute[74889]:     <acpi/>
Nov 10 12:26:40 user nova-compute[74889]:     <apic/>
Nov 10 12:26:40 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:26:40 user nova-compute[74889]:   </features>
Nov 10 12:26:40 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:26:40 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:26:40 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:26:40 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:26:40 user nova-compute[74889]:   </clock>
Nov 10 12:26:40 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:26:40 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:26:40 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:26:40 user nova-compute[74889]:   </cpu>
Nov 10 12:26:40 user nova-compute[74889]:   <devices>
Nov 10 12:26:40 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:26:40 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:26:40 user nova-compute[74889]:       <source dev="/dev/sdc"/>
Nov 10 12:26:40 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:26:40 user nova-compute[74889]:       <serial>41f28e7d-9fa0-41a9-931a-42cdbb823273</serial>
Nov 10 12:26:40 user nova-compute[74889]:     </disk>
Nov 10 12:26:40 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:26:40 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:26:40 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue"/>
Nov 10 12:26:40 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 12:26:40 user nova-compute[74889]:       <boot order="1"/>
Nov 10 12:26:40 user nova-compute[74889]:     </disk>
Nov 10 12:26:40 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:26:40 user nova-compute[74889]:       <mac address="fa:16:3e:f2:36:50"/>
Nov 10 12:26:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:26:40 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:26:40 user nova-compute[74889]:       <target dev="tap0f385cdf-45"/>
Nov 10 12:26:40 user nova-compute[74889]:     </interface>
Nov 10 12:26:40 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:26:40 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/console.log" append="off"/>
Nov 10 12:26:40 user nova-compute[74889]:     </serial>
Nov 10 12:26:40 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:26:40 user nova-compute[74889]:     <video>
Nov 10 12:26:40 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:26:40 user nova-compute[74889]:     </video>
Nov 10 12:26:40 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:26:40 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:26:40 user nova-compute[74889]:     </rng>
Nov 10 12:26:40 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:26:40 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:26:40 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:26:40 user nova-compute[74889]:     </memballoon>
Nov 10 12:26:40 user nova-compute[74889]:   </devices>
Nov 10 12:26:40 user nova-compute[74889]: </domain>
Nov 10 12:26:40 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:26:40 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Instance destroyed successfully.
Nov 10 12:26:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] No VIF found with MAC fa:16:3e:f2:36:50, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:26:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-9e6d81cb-0919-4a2a-a799-814c6d405233 req-857d56f8-e57f-46f7-9701-4e610349bc8d service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:26:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e6d81cb-0919-4a2a-a799-814c6d405233 req-857d56f8-e57f-46f7-9701-4e610349bc8d service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e6d81cb-0919-4a2a-a799-814c6d405233 req-857d56f8-e57f-46f7-9701-4e610349bc8d service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e6d81cb-0919-4a2a-a799-814c6d405233 req-857d56f8-e57f-46f7-9701-4e610349bc8d service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:41 user nova-compute[74889]: DEBUG nova.compute.manager [req-9e6d81cb-0919-4a2a-a799-814c6d405233 req-857d56f8-e57f-46f7-9701-4e610349bc8d service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:26:41 user nova-compute[74889]: WARNING nova.compute.manager [req-9e6d81cb-0919-4a2a-a799-814c6d405233 req-857d56f8-e57f-46f7-9701-4e610349bc8d service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state active and task_state rescuing.
Nov 10 12:26:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:43 user nova-compute[74889]: DEBUG nova.compute.manager [None req-bbbd5aef-83e5-45ee-a952-099d9a87c216 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:26:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-348284e7-85f5-4afc-b299-87f09cc1e56e req-87c83267-a672-49f9-bf2c-4b3573a59511 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:26:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-348284e7-85f5-4afc-b299-87f09cc1e56e req-87c83267-a672-49f9-bf2c-4b3573a59511 service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-348284e7-85f5-4afc-b299-87f09cc1e56e req-87c83267-a672-49f9-bf2c-4b3573a59511 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-348284e7-85f5-4afc-b299-87f09cc1e56e req-87c83267-a672-49f9-bf2c-4b3573a59511 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-348284e7-85f5-4afc-b299-87f09cc1e56e req-87c83267-a672-49f9-bf2c-4b3573a59511 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:26:43 user nova-compute[74889]: WARNING nova.compute.manager [req-348284e7-85f5-4afc-b299-87f09cc1e56e req-87c83267-a672-49f9-bf2c-4b3573a59511 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state active and task_state rescuing.
Nov 10 12:26:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:45 user nova-compute[74889]: DEBUG nova.objects.instance [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:26:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:26:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:26:46 user nova-compute[74889]: INFO nova.compute.manager [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attaching volume 0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 to /dev/vdb
Nov 10 12:26:46 user nova-compute[74889]: DEBUG os_brick.utils [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[89263232-3cf2-4db3-97a7-03dafa2afb34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe01278-8c82-4b16-b554-c211995a16c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cf60a3-a296-4b0e-bebb-af01fef51f04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02b886d-15d5-4593-9a01-63f61bd5e99f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:26:46 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:26:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[522dd1e6-6c73-4bd3-8534-c64acb6889eb]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG os_brick.utils [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:26:46 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updating existing volume attachment record: 8685b5e8-df39-4a47-b22e-f7163e4662ca {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:26:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:26:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:03 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'pci_requests' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:03 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'numa_topology' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:03 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:27:03 user nova-compute[74889]: INFO nova.compute.claims [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Claim successful on node user
Nov 10 12:27:04 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:04 user nova-compute[74889]: INFO nova.network.neutron [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating port b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquired lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-5dc27868-6f93-43a6-947c-2d5991cd7ddb req-9176415b-d204-4635-819a-01198c3f74b8 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-changed-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-5dc27868-6f93-43a6-947c-2d5991cd7ddb req-9176415b-d204-4635-819a-01198c3f74b8 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Refreshing instance network info cache due to event network-changed-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5dc27868-6f93-43a6-947c-2d5991cd7ddb req-9176415b-d204-4635-819a-01198c3f74b8 service nova] Acquiring lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:27:04 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updating instance_info_cache with network_info: [{"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG nova.network.neutron [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating instance_info_cache with network_info: [{"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Releasing lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:27:05 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Creating image(s)
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "/opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "/opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "/opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'trusted_certs' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5dc27868-6f93-43a6-947c-2d5991cd7ddb req-9176415b-d204-4635-819a-01198c3f74b8 service nova] Acquired lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG nova.network.neutron [req-5dc27868-6f93-43a6-947c-2d5991cd7ddb req-9176415b-d204-4635-819a-01198c3f74b8 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Refreshing network info cache for port b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG nova.objects.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Object Instance<73d95044-495c-4254-b14b-3a02c1c1dfd8> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "d597aaa019aeec71a488c8fe292c59564e0e918b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "d597aaa019aeec71a488c8fe292c59564e0e918b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b.part --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue --force-share --output=json" returned: 0 in 1.393s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b.part --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:06 user nova-compute[74889]: DEBUG nova.virt.images [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] 5cd44024-2658-44ed-8c3c-26543f8ec6c4 was qcow2, converting to raw {{(pid=74889) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 12:27:06 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:27:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b.part /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b.converted {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-5dc27868-6f93-43a6-947c-2d5991cd7ddb req-9176415b-d204-4635-819a-01198c3f74b8 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updated VIF entry in instance network info cache for port b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-5dc27868-6f93-43a6-947c-2d5991cd7ddb req-9176415b-d204-4635-819a-01198c3f74b8 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating instance_info_cache with network_info: [{"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5dc27868-6f93-43a6-947c-2d5991cd7ddb req-9176415b-d204-4635-819a-01198c3f74b8 service nova] Releasing lock "refresh_cache-73d95044-495c-4254-b14b-3a02c1c1dfd8" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b.part /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b.converted" returned: 0 in 0.463s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b.converted --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "d597aaa019aeec71a488c8fe292c59564e0e918b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.213s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "d597aaa019aeec71a488c8fe292c59564e0e918b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "d597aaa019aeec71a488c8fe292c59564e0e918b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b,backing_fmt=raw /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b,backing_fmt=raw /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk 1073741824" returned: 0 in 0.049s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "d597aaa019aeec71a488c8fe292c59564e0e918b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d597aaa019aeec71a488c8fe292c59564e0e918b --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'migration_context' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG nova.objects.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Object Instance<73d95044-495c-4254-b14b-3a02c1c1dfd8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:27:08 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Rebasing disk image.
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a -F raw /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:09 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:27:09 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:27:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8168MB free_disk=24.84046173095703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:27:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance bc9274ab-2362-42b1-a8af-06811513be55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 2d444297-e40e-4030-90a7-b934eda6fbb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (07c73308-5a33-4ed2-81ea-818734657bdc): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a -F raw /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk" returned: 0 in 2.307s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Ensure instance console log exists: /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Start _get_guest_xml network_info=[{"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c3af80b3d3dfe1dfbd86aa032308f197',container_format='bare',created_at=2023-11-10T12:24:46Z,direct_url=<?>,disk_format='qcow2',id=5cd44024-2658-44ed-8c3c-26543f8ec6c4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2053678616-shelved',owner='547570bd00724bcaafedc05b2a266490',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T12:24:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbAkBTVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '73d95044-495c-4254-b14b-3a02c1c1dfd8', 'attached_at': '', 'detached_at': '', 'volume_id': '3e67a8f1-130f-462b-8577-24f3c761ce76', 'serial': '3e67a8f1-130f-462b-8577-24f3c761ce76'}, 'disk_bus': 'virtio', 'attachment_id': '29644ee4-e9c4-4728-b544-672802f82028', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'volume_type': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.777s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:10 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:27:10 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c3af80b3d3dfe1dfbd86aa032308f197',container_format='bare',created_at=2023-11-10T12:24:46Z,direct_url=<?>,disk_format='qcow2',id=5cd44024-2658-44ed-8c3c-26543f8ec6c4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2053678616-shelved',owner='547570bd00724bcaafedc05b2a266490',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T12:24:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'vcpu_model' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.objects.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Object Instance<73d95044-495c-4254-b14b-3a02c1c1dfd8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbAkBTVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:27:10 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:27:10 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:27:10 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc103d35-84f0-40b5-b60b-606ab2cd2ba4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:27:10 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be4507c-937d-4d95-812f-58f8e30a51d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76] added
Nov 10 12:27:10 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5de011-abd9-467d-ac2f-cdfc31946632]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[079b1739-3296-44d0-a700-1611afd37350]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RbAkBTVw {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RbAkBTVw" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ad97a5-d48b-4541-8ae9-14b3d9bb440d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RbAkBTVw'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41b1581-d786-4c35-a8c2-e27b3e00ec13]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[543c9183-db36-4347-9609-e664e22a467d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:11 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:11 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRnQCSpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:27:11 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1234a1f-dacf-4c47-bf88-bc8f3cbe6688]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76, portal: 172.16.0.220,3260]
Nov 10 12:27:11 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76, portal: 172.16.0.220,3260] successful.
Nov 10 12:27:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e92862-a811-4c7c-a3ea-74164ebae742]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9801914-0c26-4d1a-8d12-3d400da6f214]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:11 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:11 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:11 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:11 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:11 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa67d5c-0c31-4d05-b97d-b2f05b1cfc86]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbAkBTVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:27:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26562383164653734', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562383164653734', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.085s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:27:12 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:27:12 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffda54a5-63d9-4467-8027-64d4c53f6054]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:27:12 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T12:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2053678616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2053678616',id=47,image_ref='5cd44024-2658-44ed-8c3c-26543f8ec6c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1550139395',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:22:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-bw70m0dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member',shelved_at='2023-11-10T12:24:50.169682',shelved_host='user',shelved_image_id='5cd44024-2658-44ed-8c3c-26543f8ec6c4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=73d95044-495c-4254-b14b-3a02c1c1dfd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.objects.instance [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'pci_devices' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.objects.base [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Object Instance<73d95044-495c-4254-b14b-3a02c1c1dfd8> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:27:12 user nova-compute[74889]:   <uuid>73d95044-495c-4254-b14b-3a02c1c1dfd8</uuid>
Nov 10 12:27:12 user nova-compute[74889]:   <name>instance-0000002f</name>
Nov 10 12:27:12 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:27:12 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:27:12 user nova-compute[74889]:   <metadata>
Nov 10 12:27:12 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:27:12 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:27:12 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2053678616</nova:name>
Nov 10 12:27:12 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:27:10</nova:creationTime>
Nov 10 12:27:12 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:27:12 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:27:12 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:27:12 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:27:12 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:27:12 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:27:12 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:27:12 user nova-compute[74889]:       <nova:owner>
Nov 10 12:27:12 user nova-compute[74889]:         <nova:user uuid="5b24ef2fdba14d0cbd34e08917e31ae5">tempest-AttachVolumeShelveTestJSON-651460361-project-member</nova:user>
Nov 10 12:27:12 user nova-compute[74889]:         <nova:project uuid="547570bd00724bcaafedc05b2a266490">tempest-AttachVolumeShelveTestJSON-651460361</nova:project>
Nov 10 12:27:12 user nova-compute[74889]:       </nova:owner>
Nov 10 12:27:12 user nova-compute[74889]:       <nova:root type="image" uuid="5cd44024-2658-44ed-8c3c-26543f8ec6c4"/>
Nov 10 12:27:12 user nova-compute[74889]:       <nova:ports>
Nov 10 12:27:12 user nova-compute[74889]:         <nova:port uuid="b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f">
Nov 10 12:27:12 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 12:27:12 user nova-compute[74889]:         </nova:port>
Nov 10 12:27:12 user nova-compute[74889]:       </nova:ports>
Nov 10 12:27:12 user nova-compute[74889]:     </nova:instance>
Nov 10 12:27:12 user nova-compute[74889]:   </metadata>
Nov 10 12:27:12 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:27:12 user nova-compute[74889]:     <system>
Nov 10 12:27:12 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:27:12 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:27:12 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:27:12 user nova-compute[74889]:       <entry name="serial">73d95044-495c-4254-b14b-3a02c1c1dfd8</entry>
Nov 10 12:27:12 user nova-compute[74889]:       <entry name="uuid">73d95044-495c-4254-b14b-3a02c1c1dfd8</entry>
Nov 10 12:27:12 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:27:12 user nova-compute[74889]:     </system>
Nov 10 12:27:12 user nova-compute[74889]:   </sysinfo>
Nov 10 12:27:12 user nova-compute[74889]:   <os>
Nov 10 12:27:12 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:27:12 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:27:12 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:27:12 user nova-compute[74889]:   </os>
Nov 10 12:27:12 user nova-compute[74889]:   <features>
Nov 10 12:27:12 user nova-compute[74889]:     <acpi/>
Nov 10 12:27:12 user nova-compute[74889]:     <apic/>
Nov 10 12:27:12 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:27:12 user nova-compute[74889]:   </features>
Nov 10 12:27:12 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:27:12 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:27:12 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:27:12 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:27:12 user nova-compute[74889]:   </clock>
Nov 10 12:27:12 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:27:12 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:27:12 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:27:12 user nova-compute[74889]:   </cpu>
Nov 10 12:27:12 user nova-compute[74889]:   <devices>
Nov 10 12:27:12 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:27:12 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:27:12 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk"/>
Nov 10 12:27:12 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:27:12 user nova-compute[74889]:     </disk>
Nov 10 12:27:12 user nova-compute[74889]:     <disk type="block" device="disk">
Nov 10 12:27:12 user nova-compute[74889]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:27:12 user nova-compute[74889]:       <source dev="/dev/sdd"/>
Nov 10 12:27:12 user nova-compute[74889]:       <target dev="vdc" bus="virtio"/>
Nov 10 12:27:12 user nova-compute[74889]:       <serial>3e67a8f1-130f-462b-8577-24f3c761ce76</serial>
Nov 10 12:27:12 user nova-compute[74889]:     </disk>
Nov 10 12:27:12 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:27:12 user nova-compute[74889]:       <mac address="fa:16:3e:d5:aa:d8"/>
Nov 10 12:27:12 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:27:12 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:27:12 user nova-compute[74889]:       <target dev="tapb76e6a59-56"/>
Nov 10 12:27:12 user nova-compute[74889]:     </interface>
Nov 10 12:27:12 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:27:12 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/console.log" append="off"/>
Nov 10 12:27:12 user nova-compute[74889]:     </serial>
Nov 10 12:27:12 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:27:12 user nova-compute[74889]:     <video>
Nov 10 12:27:12 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:27:12 user nova-compute[74889]:     </video>
Nov 10 12:27:12 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:27:12 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:27:12 user nova-compute[74889]:     </rng>
Nov 10 12:27:12 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:27:12 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:27:12 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:27:12 user nova-compute[74889]:     </memballoon>
Nov 10 12:27:12 user nova-compute[74889]:   </devices>
Nov 10 12:27:12 user nova-compute[74889]: </domain>
Nov 10 12:27:12 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T12:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2053678616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2053678616',id=47,image_ref='5cd44024-2658-44ed-8c3c-26543f8ec6c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1550139395',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:22:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-bw70m0dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member',shelved_at='2023-11-10T12:24:50.169682',shelved_host='user',shelved_image_id='5cd44024-2658-44ed-8c3c-26543f8ec6c4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:26:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=73d95044-495c-4254-b14b-3a02c1c1dfd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_vif [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01ae51e-8371-4570-bb95-fc20b4227e8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303] added
Nov 10 12:27:12 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0fb8d36-29a9-5169-8aab-04efb4e173c4', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb76e6a59-56, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb76e6a59-56, col_values=(('qos', UUID('6665aa21-2ae6-4460-a84c-f8a3d037a895')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb76e6a59-56, col_values=(('external_ids', {'iface-id': 'b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:aa:d8', 'vm-uuid': '73d95044-495c-4254-b14b-3a02c1c1dfd8'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cd9475-a381-48f6-998c-0286c51fbc10]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:12 user nova-compute[74889]: INFO os_vif [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56')
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a57575d-51d2-4e96-96a1-2b6903d73342]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRnQCSpk {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRnQCSpk" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7612f7-dfce-4ff1-8c20-6c69ba1b77e8]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yRnQCSpk'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] No VIF found with MAC fa:16:3e:d5:aa:d8, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6393cf21-0130-4bd0-b6a0-54debbe08a2f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bbea24-18a0-47e4-b3e9-72543ec02fb9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[806e25bd-b14c-4e5a-8594-47d3b18c4d9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303, portal: 172.16.0.220,3260]
Nov 10 12:27:12 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303, portal: 172.16.0.220,3260] successful.
Nov 10 12:27:12 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feea55b-4cc2-4bd0-9d06-6d90cdb37bab]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9c67af-160e-4041-9d2f-8bdbc1917549]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 (non-flash)
Nov 10 12:27:12 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a623fc-3246-4705-8822-b25b9def3536]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:27:12 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRnQCSpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== connect_volume: return (2448ms) {'type': 'block', 'scsi_wwn': '26262343238666134', 'path': '/dev/sde'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262343238666134', 'path': '/dev/sde'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG nova.objects.instance [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:27:13 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:27:13 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:27:13 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:27:13 user nova-compute[74889]:   <serial>0f1fee3f-2ae8-4ce4-a873-517e0cfe2303</serial>
Nov 10 12:27:13 user nova-compute[74889]: </disk>
Nov 10 12:27:13 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-7f7b3aae-1cdd-44a4-b156-e3d2ce13d97d req-6fa35f64-4232-4521-b491-1de93b1d7e2e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7f7b3aae-1cdd-44a4-b156-e3d2ce13d97d req-6fa35f64-4232-4521-b491-1de93b1d7e2e service nova] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7f7b3aae-1cdd-44a4-b156-e3d2ce13d97d req-6fa35f64-4232-4521-b491-1de93b1d7e2e service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-7f7b3aae-1cdd-44a4-b156-e3d2ce13d97d req-6fa35f64-4232-4521-b491-1de93b1d7e2e service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:13 user nova-compute[74889]: DEBUG nova.compute.manager [req-7f7b3aae-1cdd-44a4-b156-e3d2ce13d97d req-6fa35f64-4232-4521-b491-1de93b1d7e2e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] No waiting events found dispatching network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:27:13 user nova-compute[74889]: WARNING nova.compute.manager [req-7f7b3aae-1cdd-44a4-b156-e3d2ce13d97d req-6fa35f64-4232-4521-b491-1de93b1d7e2e service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received unexpected event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 12:27:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No VIF found with MAC fa:16:3e:bc:b5:4d, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3b975f5c-7f5c-49f1-9e4d-63334f696b35 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.267s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-2ceaf342-82d2-4d3e-9eca-96ce1350b92f req-0125d6da-ec6e-46e0-a00f-852a5ff623b5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-changed-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-2ceaf342-82d2-4d3e-9eca-96ce1350b92f req-0125d6da-ec6e-46e0-a00f-852a5ff623b5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Refreshing instance network info cache due to event network-changed-986baf45-7347-40ae-81d3-a36a1fd1eb55. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2ceaf342-82d2-4d3e-9eca-96ce1350b92f req-0125d6da-ec6e-46e0-a00f-852a5ff623b5 service nova] Acquiring lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2ceaf342-82d2-4d3e-9eca-96ce1350b92f req-0125d6da-ec6e-46e0-a00f-852a5ff623b5 service nova] Acquired lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG nova.network.neutron [req-2ceaf342-82d2-4d3e-9eca-96ce1350b92f req-0125d6da-ec6e-46e0-a00f-852a5ff623b5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Refreshing network info cache for port 986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG nova.objects.instance [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'flavor' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:14 user nova-compute[74889]: INFO nova.compute.manager [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Attaching volume 0cc09d65-0f08-4041-974e-8b867af7f534 to /dev/vdb
Nov 10 12:27:15 user nova-compute[74889]: DEBUG os_brick.utils [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[39264365-c240-48d4-85f1-8d8f97ce352c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-2ceaf342-82d2-4d3e-9eca-96ce1350b92f req-0125d6da-ec6e-46e0-a00f-852a5ff623b5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updated VIF entry in instance network info cache for port 986baf45-7347-40ae-81d3-a36a1fd1eb55. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-2ceaf342-82d2-4d3e-9eca-96ce1350b92f req-0125d6da-ec6e-46e0-a00f-852a5ff623b5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updating instance_info_cache with network_info: [{"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ad1093-eae1-4a15-a30d-88d70f227024]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2ceaf342-82d2-4d3e-9eca-96ce1350b92f req-0125d6da-ec6e-46e0-a00f-852a5ff623b5 service nova] Releasing lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85134b5-1c28-4f0e-8ab9-105f0189491a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0abacd-5d3b-462b-a028-59d250d7d9e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:27:15 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e623140a-8b6e-4e08-93ca-ce3ff74fd790]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG os_brick.utils [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updating existing volume attachment record: 348c9fc3-8611-4cd4-84cd-39713266453f {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-cb373393-23d6-435f-af87-748e0dc9ba7e req-36ad0454-8ce5-4186-a7e1-a9588c256bd8 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb373393-23d6-435f-af87-748e0dc9ba7e req-36ad0454-8ce5-4186-a7e1-a9588c256bd8 service nova] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb373393-23d6-435f-af87-748e0dc9ba7e req-36ad0454-8ce5-4186-a7e1-a9588c256bd8 service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-cb373393-23d6-435f-af87-748e0dc9ba7e req-36ad0454-8ce5-4186-a7e1-a9588c256bd8 service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-cb373393-23d6-435f-af87-748e0dc9ba7e req-36ad0454-8ce5-4186-a7e1-a9588c256bd8 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] No waiting events found dispatching network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:27:15 user nova-compute[74889]: WARNING nova.compute.manager [req-cb373393-23d6-435f-af87-748e0dc9ba7e req-36ad0454-8ce5-4186-a7e1-a9588c256bd8 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received unexpected event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 12:27:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:27:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:27:16 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance spawned successfully.
Nov 10 12:27:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:27:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-6d0485d9-dee7-4902-8bef-29a5b8b72c2c tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 37.826s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:16 user nova-compute[74889]: INFO nova.compute.manager [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Detaching volume 0f1fee3f-2ae8-4ce4-a873-517e0cfe2303
Nov 10 12:27:16 user nova-compute[74889]: INFO nova.virt.block_device [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attempting to driver detach volume 0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 from mountpoint /dev/vdb
Nov 10 12:27:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Attempting to detach device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:27:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:27:16 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:27:16 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:27:16 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:27:16 user nova-compute[74889]:   <serial>0f1fee3f-2ae8-4ce4-a873-517e0cfe2303</serial>
Nov 10 12:27:16 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:27:16 user nova-compute[74889]: </disk>
Nov 10 12:27:16 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:27:16 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Successfully detached device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the persistent domain config.
Nov 10 12:27:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:27:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:27:16 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:27:16 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:27:16 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:27:16 user nova-compute[74889]:   <serial>0f1fee3f-2ae8-4ce4-a873-517e0cfe2303</serial>
Nov 10 12:27:16 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:27:16 user nova-compute[74889]: </disk>
Nov 10 12:27:16 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:27:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:27:19 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:27:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:25 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:27:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:37 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d58137e4-403b-45af-b9fc-64a2c5efe819 is timed out.
Nov 10 12:27:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:37 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Successfully detached device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the live domain config.
Nov 10 12:27:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRnQCSpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:27:37 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bc6c17-7c78-4c74-be85-3231d9475178]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:27:37 user nova-compute[74889]: No targets found.
Nov 10 12:27:37 user nova-compute[74889]: iSNS:
Nov 10 12:27:37 user nova-compute[74889]: No targets found.
Nov 10 12:27:37 user nova-compute[74889]: STATIC:
Nov 10 12:27:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273
Nov 10 12:27:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:27:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:27:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76
Nov 10 12:27:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:27:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:27:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303
Nov 10 12:27:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:27:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:27:37 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:27:37 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:27:37 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:27:37 user nova-compute[74889]: FIRMWARE:
Nov 10 12:27:37 user nova-compute[74889]: No targets found.
Nov 10 12:27:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:27:37 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:27:37 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a97d3b-b068-4075-8e7d-405786c59107]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdc7a12-8ca1-42d2-8b7c-70379ea88b8b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:37 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:37 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:37 user nova-compute[74889]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 (non-flash)
Nov 10 12:27:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:37 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:37 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:37 user nova-compute[74889]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 (non-flash)
Nov 10 12:27:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398225120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303'): ({'sde'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Removing single pathed devices sde {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a45f35-7f2b-44ae-8033-b7e443fc825c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffe5a36-793b-4802-8a23-aa472d234659]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Flushing IO for device /dev/sde {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e319d4d-c908-494c-9f94-1a6894aa23ba]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a869b92-32cd-44e1-84c2-02dfd0be8620]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa48094-dae7-4c55-b735-79098af09522]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d4351c-96c1-48b1-9d5e-9c33b1adef6b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303, portal: 172.16.0.220,3260]
Nov 10 12:27:37 user nova-compute[74889]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303, portal: 172.16.0.220,3260] successful.
Nov 10 12:27:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f1fee3f-2ae8-4ce4-a873-517e0cfe2303 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9954e7b3-8745-4328-9595-a35b93ba9f69]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== disconnect_volume: return (313ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:27:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:27:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a98a5598-c79f-4e54-a0a9-df391fc6d481 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.288s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkToQwJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:27:40 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:27:40 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:27:40 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[421f7e95-8d02-46ed-8243-25f11721f29b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:27:40 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[919cafd6-cd7d-4e71-b68d-a6a1eef24ec0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534] added
Nov 10 12:27:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a376239b-fe9e-4ac7-995d-a40fe968a253]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3365bb-ef75-45b6-8091-34615c51be27]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkToQwJl {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkToQwJl" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd32352-faff-4d9a-aee7-970e29e32244]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkToQwJl'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f4de41-46bc-4dab-ae06-5c38d1f0cb44]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79fdd45-deb4-4c19-beac-32061d713b7b]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[338bba7c-87c2-441e-8b93-050655137f44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534, portal: 172.16.0.220,3260]
Nov 10 12:27:40 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534, portal: 172.16.0.220,3260] successful.
Nov 10 12:27:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd41055-89a2-48cb-9824-2b248394c60d]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[10470904-9175-44ba-bd4f-fa8db43fa3e7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:27:40 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] HCTL ('36', '-', '-', 0) found on session 54 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf70049a-8992-478f-aea1-e8c79c3ef6cc]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:27:40 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkToQwJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23039613232636462', 'path': '/dev/sde'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039613232636462', 'path': '/dev/sde'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG nova.objects.instance [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'flavor' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:27:41 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:27:41 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:27:41 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:27:41 user nova-compute[74889]:   <serial>0cc09d65-0f08-4041-974e-8b867af7f534</serial>
Nov 10 12:27:41 user nova-compute[74889]: </disk>
Nov 10 12:27:41 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No VIF found with MAC fa:16:3e:dd:ba:c5, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:27:41 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3f829b09-ab9f-429e-bd02-9bb39a369931 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.998s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:43 user nova-compute[74889]: INFO nova.compute.manager [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Rescuing
Nov 10 12:27:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquired lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG nova.network.neutron [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updating instance_info_cache with network_info: [{"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Releasing lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-fa3bec70-a21c-4c11-97fb-9581bee2c9e7 req-dd0c08c9-e290-4cb4-8f68-61fd50000541 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-unplugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fa3bec70-a21c-4c11-97fb-9581bee2c9e7 req-dd0c08c9-e290-4cb4-8f68-61fd50000541 service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fa3bec70-a21c-4c11-97fb-9581bee2c9e7 req-dd0c08c9-e290-4cb4-8f68-61fd50000541 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-fa3bec70-a21c-4c11-97fb-9581bee2c9e7 req-dd0c08c9-e290-4cb4-8f68-61fd50000541 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG nova.compute.manager [req-fa3bec70-a21c-4c11-97fb-9581bee2c9e7 req-dd0c08c9-e290-4cb4-8f68-61fd50000541 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-unplugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:27:43 user nova-compute[74889]: WARNING nova.compute.manager [req-fa3bec70-a21c-4c11-97fb-9581bee2c9e7 req-dd0c08c9-e290-4cb4-8f68-61fd50000541 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-unplugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state active and task_state rescuing.
Nov 10 12:27:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Instance destroyed successfully.
Nov 10 12:27:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Attempting rescue
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74889) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Instance directory exists: not creating {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 12:27:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Creating image(s)
Nov 10 12:27:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.instance [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue" returned: 0 in 0.055s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.instance [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'migration_context' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.base [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<2d444297-e40e-4030-90a7-b934eda6fbb6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Start _get_guest_xml network_info=[{"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "vif_mac": "fa:16:3e:dd:ba:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.instance [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'resources' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.base [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<2d444297-e40e-4030-90a7-b934eda6fbb6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.instance [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'numa_topology' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.base [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<2d444297-e40e-4030-90a7-b934eda6fbb6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:27:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:27:44 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.instance [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.base [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<2d444297-e40e-4030-90a7-b934eda6fbb6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:25:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2118297203',display_name='tempest-ServerRescueNegativeTestJSON-server-2118297203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2118297203',id=49,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8JrWJfsnCMq/p+fZnn0MmDRW/cQ2ks9/NQlTsYsc3MwL6GMJYodz/XgnmHBD9v23FxsV+LGd8yLrA9FsiMiAELpz7414q/TrallGPqcEt5fwkwwiQTUFAlB12DIkq1aw==',key_name='tempest-keypair-676962485',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:25:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-zzkqnust',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:25:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=2d444297-e40e-4030-90a7-b934eda6fbb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "vif_mac": "fa:16:3e:dd:ba:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "vif_mac": "fa:16:3e:dd:ba:c5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:ba:c5,bridge_name='br-int',has_traffic_filtering=True,id=986baf45-7347-40ae-81d3-a36a1fd1eb55,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986baf45-73') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.instance [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.objects.base [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Object Instance<2d444297-e40e-4030-90a7-b934eda6fbb6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:27:44 user nova-compute[74889]:   <uuid>2d444297-e40e-4030-90a7-b934eda6fbb6</uuid>
Nov 10 12:27:44 user nova-compute[74889]:   <name>instance-00000031</name>
Nov 10 12:27:44 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:27:44 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:27:44 user nova-compute[74889]:   <metadata>
Nov 10 12:27:44 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:27:44 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:27:44 user nova-compute[74889]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2118297203</nova:name>
Nov 10 12:27:44 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:27:44</nova:creationTime>
Nov 10 12:27:44 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:27:44 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:27:44 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:27:44 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:27:44 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:27:44 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:27:44 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:27:44 user nova-compute[74889]:       <nova:owner>
Nov 10 12:27:44 user nova-compute[74889]:         <nova:user uuid="db6e671b33f14840b2a79a3affbbaaa8">tempest-ServerRescueNegativeTestJSON-524488673-project-member</nova:user>
Nov 10 12:27:44 user nova-compute[74889]:         <nova:project uuid="62c4b9efdfb14eadb63b747cc3c6003f">tempest-ServerRescueNegativeTestJSON-524488673</nova:project>
Nov 10 12:27:44 user nova-compute[74889]:       </nova:owner>
Nov 10 12:27:44 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:27:44 user nova-compute[74889]:       <nova:ports>
Nov 10 12:27:44 user nova-compute[74889]:         <nova:port uuid="986baf45-7347-40ae-81d3-a36a1fd1eb55">
Nov 10 12:27:44 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 12:27:44 user nova-compute[74889]:         </nova:port>
Nov 10 12:27:44 user nova-compute[74889]:       </nova:ports>
Nov 10 12:27:44 user nova-compute[74889]:     </nova:instance>
Nov 10 12:27:44 user nova-compute[74889]:   </metadata>
Nov 10 12:27:44 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:27:44 user nova-compute[74889]:     <system>
Nov 10 12:27:44 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:27:44 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:27:44 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:27:44 user nova-compute[74889]:       <entry name="serial">2d444297-e40e-4030-90a7-b934eda6fbb6</entry>
Nov 10 12:27:44 user nova-compute[74889]:       <entry name="uuid">2d444297-e40e-4030-90a7-b934eda6fbb6</entry>
Nov 10 12:27:44 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:27:44 user nova-compute[74889]:     </system>
Nov 10 12:27:44 user nova-compute[74889]:   </sysinfo>
Nov 10 12:27:44 user nova-compute[74889]:   <os>
Nov 10 12:27:44 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:27:44 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:27:44 user nova-compute[74889]:   </os>
Nov 10 12:27:44 user nova-compute[74889]:   <features>
Nov 10 12:27:44 user nova-compute[74889]:     <acpi/>
Nov 10 12:27:44 user nova-compute[74889]:     <apic/>
Nov 10 12:27:44 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:27:44 user nova-compute[74889]:   </features>
Nov 10 12:27:44 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:27:44 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:27:44 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:27:44 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:27:44 user nova-compute[74889]:   </clock>
Nov 10 12:27:44 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:27:44 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:27:44 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:27:44 user nova-compute[74889]:   </cpu>
Nov 10 12:27:44 user nova-compute[74889]:   <devices>
Nov 10 12:27:44 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:27:44 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:27:44 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue"/>
Nov 10 12:27:44 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:27:44 user nova-compute[74889]:     </disk>
Nov 10 12:27:44 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:27:44 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:27:44 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk"/>
Nov 10 12:27:44 user nova-compute[74889]:       <target dev="vdb" bus="virtio"/>
Nov 10 12:27:44 user nova-compute[74889]:     </disk>
Nov 10 12:27:44 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:27:44 user nova-compute[74889]:       <mac address="fa:16:3e:dd:ba:c5"/>
Nov 10 12:27:44 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:27:44 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:27:44 user nova-compute[74889]:       <target dev="tap986baf45-73"/>
Nov 10 12:27:44 user nova-compute[74889]:     </interface>
Nov 10 12:27:44 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:27:44 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/console.log" append="off"/>
Nov 10 12:27:44 user nova-compute[74889]:     </serial>
Nov 10 12:27:44 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:27:44 user nova-compute[74889]:     <video>
Nov 10 12:27:44 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:27:44 user nova-compute[74889]:     </video>
Nov 10 12:27:44 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:27:44 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:27:44 user nova-compute[74889]:     </rng>
Nov 10 12:27:44 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:27:44 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:27:44 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:27:44 user nova-compute[74889]:     </memballoon>
Nov 10 12:27:44 user nova-compute[74889]:   </devices>
Nov 10 12:27:44 user nova-compute[74889]: </domain>
Nov 10 12:27:44 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:27:44 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Instance destroyed successfully.
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:27:44 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] No VIF found with MAC fa:16:3e:dd:ba:c5, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:27:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-3709d194-599f-4fe0-a203-c7a205279690 req-1bcbbd7c-573e-4713-a4eb-b3b63e0f949a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:27:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3709d194-599f-4fe0-a203-c7a205279690 req-1bcbbd7c-573e-4713-a4eb-b3b63e0f949a service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3709d194-599f-4fe0-a203-c7a205279690 req-1bcbbd7c-573e-4713-a4eb-b3b63e0f949a service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:45 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3709d194-599f-4fe0-a203-c7a205279690 req-1bcbbd7c-573e-4713-a4eb-b3b63e0f949a service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:45 user nova-compute[74889]: DEBUG nova.compute.manager [req-3709d194-599f-4fe0-a203-c7a205279690 req-1bcbbd7c-573e-4713-a4eb-b3b63e0f949a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:27:45 user nova-compute[74889]: WARNING nova.compute.manager [req-3709d194-599f-4fe0-a203-c7a205279690 req-1bcbbd7c-573e-4713-a4eb-b3b63e0f949a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state active and task_state rescuing.
Nov 10 12:27:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:27:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:27:47 user nova-compute[74889]: WARNING nova.compute.manager [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state active and task_state rescuing.
Nov 10 12:27:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:27:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:27:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:27:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:27:47 user nova-compute[74889]: DEBUG nova.compute.manager [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:27:47 user nova-compute[74889]: WARNING nova.compute.manager [req-575bce24-38b2-4c80-a69f-25b70d3d3ad9 req-5b089e09-e8c6-446d-aa39-da97f024d9c5 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state active and task_state rescuing.
Nov 10 12:27:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-dad92e64-765e-42d1-a992-6cc4766a2af6 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:27:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:27:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:28:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:28:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:28:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:28:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:28:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:03 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:28:03 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:28:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-990a099a-7893-4428-9de1-8dc217bf2fc0" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:28:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-990a099a-7893-4428-9de1-8dc217bf2fc0" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:28:03 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:28:03 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Updating instance_info_cache with network_info: [{"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:28:03 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-990a099a-7893-4428-9de1-8dc217bf2fc0" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:28:03 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:05 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:09 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:28:09 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8057MB free_disk=24.812129974365234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance bc9274ab-2362-42b1-a8af-06811513be55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 2d444297-e40e-4030-90a7-b934eda6fbb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing inventories for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating ProviderTree inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing aggregate associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, aggregates: None {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 12:28:09 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing trait associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 12:28:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:10 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:28:10 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:28:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:28:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.711s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:28:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:28:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:28:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:28:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:28:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:13 user nova-compute[74889]: INFO nova.compute.manager [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attaching volume 923ebb08-189c-42fe-a109-b399c8c9128b to /dev/vdb
Nov 10 12:28:13 user nova-compute[74889]: DEBUG os_brick.utils [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e01425-edc1-4660-b3e1-bd18e814f960]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff3b0d2-dce3-48ab-a737-d1af7dd01746]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31b1f19-798a-4092-8fc4-d8a265bee1aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc76083-1cfb-406c-88f9-e8dfa25163a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:28:13 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:28:13 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01550ed-8fcd-473e-9324-898bb88940bf]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG os_brick.utils [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:28:13 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updating existing volume attachment record: 4b11e2d3-51dc-4e9f-8593-7ddb945accab {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:28:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 662a3c8c-e0b0-4dea-b620-d11de1c5a92e {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 3824b4fa-25e2-436d-87d8-762353765644 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 990a099a-7893-4428-9de1-8dc217bf2fc0 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid bc9274ab-2362-42b1-a8af-06811513be55 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "7f361287-3a8c-4422-992d-709d48c7c663" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "de32b888-15ed-42eb-9029-1cb3dc471253" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "3824b4fa-25e2-436d-87d8-762353765644" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "bc9274ab-2362-42b1-a8af-06811513be55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "7f361287-3a8c-4422-992d-709d48c7c663" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "de32b888-15ed-42eb-9029-1cb3dc471253" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "3824b4fa-25e2-436d-87d8-762353765644" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "bc9274ab-2362-42b1-a8af-06811513be55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:27 user nova-compute[74889]: INFO nova.compute.manager [None req-ecc3f0b2-d20f-4d90-ba88-aed96b2e0b8f tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Unrescuing
Nov 10 12:28:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ecc3f0b2-d20f-4d90-ba88-aed96b2e0b8f tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ecc3f0b2-d20f-4d90-ba88-aed96b2e0b8f tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquired lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ecc3f0b2-d20f-4d90-ba88-aed96b2e0b8f tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG nova.network.neutron [None req-ecc3f0b2-d20f-4d90-ba88-aed96b2e0b8f tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Updating instance_info_cache with network_info: [{"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-ecc3f0b2-d20f-4d90-ba88-aed96b2e0b8f tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Releasing lock "refresh_cache-bc9274ab-2362-42b1-a8af-06811513be55" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG nova.objects.instance [None req-ecc3f0b2-d20f-4d90-ba88-aed96b2e0b8f tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'flavor' on Instance uuid bc9274ab-2362-42b1-a8af-06811513be55 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-1378d718-a15b-4db0-9e3c-d89293e44bb0 req-b9ab0416-5238-4def-ac68-dcbca5f5b719 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1378d718-a15b-4db0-9e3c-d89293e44bb0 req-b9ab0416-5238-4def-ac68-dcbca5f5b719 service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1378d718-a15b-4db0-9e3c-d89293e44bb0 req-b9ab0416-5238-4def-ac68-dcbca5f5b719 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-1378d718-a15b-4db0-9e3c-d89293e44bb0 req-b9ab0416-5238-4def-ac68-dcbca5f5b719 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-1378d718-a15b-4db0-9e3c-d89293e44bb0 req-b9ab0416-5238-4def-ac68-dcbca5f5b719 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:28:27 user nova-compute[74889]: WARNING nova.compute.manager [req-1378d718-a15b-4db0-9e3c-d89293e44bb0 req-b9ab0416-5238-4def-ac68-dcbca5f5b719 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:28:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:28 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Instance destroyed successfully.
Nov 10 12:28:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:28 user nova-compute[74889]: INFO nova.compute.manager [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Detaching volume 3e67a8f1-130f-462b-8577-24f3c761ce76
Nov 10 12:28:28 user nova-compute[74889]: INFO nova.virt.block_device [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Attempting to driver detach volume 3e67a8f1-130f-462b-8577-24f3c761ce76 from mountpoint /dev/vdc
Nov 10 12:28:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Attempting to detach device vdc from instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:28:28 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:28:28 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:28:28 user nova-compute[74889]:   <target dev="vdc" bus="virtio"/>
Nov 10 12:28:28 user nova-compute[74889]:   <serial>3e67a8f1-130f-462b-8577-24f3c761ce76</serial>
Nov 10 12:28:28 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 12:28:28 user nova-compute[74889]: </disk>
Nov 10 12:28:28 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:28:28 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Successfully detached device vdc from instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 from the persistent domain config.
Nov 10 12:28:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:28:28 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:28:28 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:28:28 user nova-compute[74889]:   <target dev="vdc" bus="virtio"/>
Nov 10 12:28:28 user nova-compute[74889]:   <serial>3e67a8f1-130f-462b-8577-24f3c761ce76</serial>
Nov 10 12:28:28 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 12:28:28 user nova-compute[74889]: </disk>
Nov 10 12:28:28 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:28:29 user nova-compute[74889]: WARNING nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:28:29 user nova-compute[74889]: WARNING nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:28:29 user nova-compute[74889]: WARNING nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:28:29 user nova-compute[74889]: WARNING nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:28:29 user nova-compute[74889]: WARNING nova.compute.manager [req-2f31c4d4-8d47-40b6-a9a8-c16d227a10d9 req-8baddf0c-3858-43a0-a900-23c30b4cae32 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:28:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:28:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:28:31 user nova-compute[74889]: WARNING nova.compute.manager [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:28:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:28:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:28:31 user nova-compute[74889]: WARNING nova.compute.manager [req-49981bcd-c41e-443a-88c3-c4cd4337027d req-2e2d86cc-1643-40b9-a232-24589dcabb4b service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:28:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-ecc3f0b2-d20f-4d90-ba88-aed96b2e0b8f tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:28:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XwxzUKhE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:28:37 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:28:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:28:37 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:28:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:28:37 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:28:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeec3e2-cdb0-4a1b-bbfc-8573f113233b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:28:37 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d775a1-fbff-4a64-9875-c0b872506565]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b] added
Nov 10 12:28:37 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed997e3f-711b-4ab7-9dfc-309746528298]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:37 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b77b821-8243-4425-829c-7fc9a1f770dd]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XwxzUKhE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XwxzUKhE" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f92b97-84a9-4cf7-9a04-72c9e4da01aa]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XwxzUKhE'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3af0cd-0284-4a31-9dad-9bd73ad66d47]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[796cb389-f786-4f62-bd9e-1c8422286054]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[866c06d6-2261-4a06-8a91-222af8c7f09a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b, portal: 172.16.0.220,3260]
Nov 10 12:28:38 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b, portal: 172.16.0.220,3260] successful.
Nov 10 12:28:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff37e54b-066b-461a-b65f-c3ae6b5cf031]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bbf79b-bb79-4636-9f19-62084798f27f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b (non-flash)
Nov 10 12:28:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:28:38 user nova-compute[74889]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b (non-flash)
Nov 10 12:28:38 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] HCTL ('37', '-', '-', 0) found on session 55 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20b6d48-1725-4ce1-ba8c-eeea548eee08]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Searching for a device in session 55 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:28:38 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XwxzUKhE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23765323938316134', 'path': '/dev/sdf'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765323938316134', 'path': '/dev/sdf'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:28:39 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:28:39 user nova-compute[74889]:   <source dev="/dev/sdf"/>
Nov 10 12:28:39 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:28:39 user nova-compute[74889]:   <serial>923ebb08-189c-42fe-a109-b399c8c9128b</serial>
Nov 10 12:28:39 user nova-compute[74889]: </disk>
Nov 10 12:28:39 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No VIF found with MAC fa:16:3e:bc:b5:4d, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f02ed8af-8d66-44af-91ea-f9b53381daeb tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.672s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.281s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:28:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:28:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:28:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:28:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:28:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:28:42 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:28:42 user nova-compute[74889]: INFO nova.compute.manager [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Detaching volume 923ebb08-189c-42fe-a109-b399c8c9128b
Nov 10 12:28:42 user nova-compute[74889]: INFO nova.virt.block_device [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attempting to driver detach volume 923ebb08-189c-42fe-a109-b399c8c9128b from mountpoint /dev/vdb
Nov 10 12:28:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Attempting to detach device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:28:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:28:42 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:28:42 user nova-compute[74889]:   <source dev="/dev/sdf"/>
Nov 10 12:28:42 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:28:42 user nova-compute[74889]:   <serial>923ebb08-189c-42fe-a109-b399c8c9128b</serial>
Nov 10 12:28:42 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:28:42 user nova-compute[74889]: </disk>
Nov 10 12:28:42 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:28:42 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Successfully detached device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the persistent domain config.
Nov 10 12:28:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:28:42 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:28:42 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:28:42 user nova-compute[74889]:   <source dev="/dev/sdf"/>
Nov 10 12:28:42 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:28:42 user nova-compute[74889]:   <serial>923ebb08-189c-42fe-a109-b399c8c9128b</serial>
Nov 10 12:28:42 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:28:42 user nova-compute[74889]: </disk>
Nov 10 12:28:42 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:28:43 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:28:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:49 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 is timed out.
Nov 10 12:28:49 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Successfully detached device vdc from instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 from the live domain config.
Nov 10 12:28:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RbAkBTVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:28:49 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[96233b63-365b-47ca-a8f5-c0c9348b3055]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:28:49 user nova-compute[74889]: No targets found.
Nov 10 12:28:49 user nova-compute[74889]: iSNS:
Nov 10 12:28:49 user nova-compute[74889]: No targets found.
Nov 10 12:28:49 user nova-compute[74889]: STATIC:
Nov 10 12:28:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273
Nov 10 12:28:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:28:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:28:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76
Nov 10 12:28:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:28:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:28:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b
Nov 10 12:28:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:28:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:28:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534
Nov 10 12:28:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:28:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:28:49 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:28:49 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:28:49 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:28:49 user nova-compute[74889]: FIRMWARE:
Nov 10 12:28:49 user nova-compute[74889]: No targets found.
Nov 10 12:28:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:28:49 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:28:49 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c19de07-bfba-4aff-a6e4-0568a9550383]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4006f0-8887-49a8-9488-134712b51d98]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:28:49 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:28:49 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:28:49 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:28:49 user nova-compute[74889]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b (non-flash)
Nov 10 12:28:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:28:49 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:28:49 user nova-compute[74889]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 (non-flash)
Nov 10 12:28:49 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:28:49 user nova-compute[74889]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b (non-flash)
Nov 10 12:28:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398227a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f373152e-0052-4059-a162-d347407b27fa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7606e727-f8ba-48d9-b82a-643eb6b96ecd]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f304f0-649c-4a04-ba75-7e7b85e06725]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ebd2e0-f311-4219-8990-5fa07407cb0e]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e527f90a-d523-4f9a-b076-229ff30f8dac]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[277a16c0-732c-4a58-afb3-ac31ad05d5dc]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76, portal: 172.16.0.220,3260]
Nov 10 12:28:49 user nova-compute[74889]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76, portal: 172.16.0.220,3260] successful.
Nov 10 12:28:49 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e67a8f1-130f-462b-8577-24f3c761ce76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[063a83a2-7e15-4df7-8fda-215c0d216e3c]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] <== disconnect_volume: return (330ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:28:49 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:28:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:50 user nova-compute[74889]: DEBUG nova.objects.instance [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'flavor' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:28:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-bb532cf4-c118-4f94-9b2f-3130cf3742ba tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.909s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:28:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:28:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:03 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d58137e4-403b-45af-b9fc-64a2c5efe819 is timed out.
Nov 10 12:29:03 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Successfully detached device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the live domain config.
Nov 10 12:29:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XwxzUKhE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:29:03 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ffc1c6-f108-479b-a066-74a71655f1e6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:29:03 user nova-compute[74889]: No targets found.
Nov 10 12:29:03 user nova-compute[74889]: iSNS:
Nov 10 12:29:03 user nova-compute[74889]: No targets found.
Nov 10 12:29:03 user nova-compute[74889]: STATIC:
Nov 10 12:29:03 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273
Nov 10 12:29:03 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:29:03 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:29:03 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b
Nov 10 12:29:03 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:29:03 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:29:03 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534
Nov 10 12:29:03 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:29:03 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:29:03 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:29:03 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:29:03 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:29:03 user nova-compute[74889]: FIRMWARE:
Nov 10 12:29:03 user nova-compute[74889]: No targets found.
Nov 10 12:29:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:29:03 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:29:03 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a70f38d-466f-49db-aaf6-47d72917c295]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[31329796-47ef-49e1-9776-db3871d42e74]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:29:03 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:29:03 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:29:03 user nova-compute[74889]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b (non-flash)
Nov 10 12:29:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:29:03 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:29:03 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:29:03 user nova-compute[74889]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b (non-flash)
Nov 10 12:29:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa398396050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b'): ({'sdf'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Removing single pathed devices sdf {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba1eaaa-ca2b-48cf-a8e3-4065e5d087e1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1a6354-a4cd-481a-a47c-0171dcd56ff6]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Flushing IO for device /dev/sdf {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[192caa29-ab75-4a8b-88c4-872cdf72d918]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84396ec-b7f1-4764-b1ea-80c1f322af56]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] SCSI volumes sdf have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ae03b0-21f3-40da-af74-996a5c528087]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfcc9b5-584a-4c80-9df5-19b99c5290be]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b, portal: 172.16.0.220,3260]
Nov 10 12:29:03 user nova-compute[74889]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b, portal: 172.16.0.220,3260] successful.
Nov 10 12:29:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:923ebb08-189c-42fe-a109-b399c8c9128b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[022addd2-f361-4217-9bd3-17d40b22e856]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== disconnect_volume: return (360ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:29:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:29:04 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:29:04 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:29:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:29:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:29:04 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:29:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:29:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f0fd58fd-4ede-48da-a1cd-3f44f42d9952 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.985s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:04 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updating instance_info_cache with network_info: [{"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:29:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-d58137e4-403b-45af-b9fc-64a2c5efe819" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:29:04 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:29:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:29:06 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.286s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:09 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:29:09 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:29:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8019MB free_disk=24.811233520507812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:29:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance bc9274ab-2362-42b1-a8af-06811513be55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 2d444297-e40e-4030-90a7-b934eda6fbb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:29:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.468s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:29:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:29:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:29:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:29:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:29:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:29:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:29:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:19 user nova-compute[74889]: INFO nova.compute.manager [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Terminating instance
Nov 10 12:29:19 user nova-compute[74889]: DEBUG nova.compute.manager [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-4173620d-0145-4f77-9b3a-50a1c8d3804b req-e5a77402-2701-4f01-b8cb-ead98b3442a5 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-vif-unplugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4173620d-0145-4f77-9b3a-50a1c8d3804b req-e5a77402-2701-4f01-b8cb-ead98b3442a5 service nova] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4173620d-0145-4f77-9b3a-50a1c8d3804b req-e5a77402-2701-4f01-b8cb-ead98b3442a5 service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-4173620d-0145-4f77-9b3a-50a1c8d3804b req-e5a77402-2701-4f01-b8cb-ead98b3442a5 service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-4173620d-0145-4f77-9b3a-50a1c8d3804b req-e5a77402-2701-4f01-b8cb-ead98b3442a5 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] No waiting events found dispatching network-vif-unplugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG nova.compute.manager [req-4173620d-0145-4f77-9b3a-50a1c8d3804b req-e5a77402-2701-4f01-b8cb-ead98b3442a5 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-vif-unplugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:29:19 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Instance destroyed successfully.
Nov 10 12:29:19 user nova-compute[74889]: DEBUG nova.objects.instance [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'resources' on Instance uuid 73d95044-495c-4254-b14b-3a02c1c1dfd8 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T12:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2053678616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2053678616',id=47,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAi+CFstq2853qShl+H0CVY3FFH6hxyBnSO7JBWtayf1NbcqqH38RXu0/Qh13T/4HP2p50UEbiVYZgFUY3XwtK169awAETyoIQGYPwXHbsYMu3PdwGMCB3LdMdrAyr9s7A==',key_name='tempest-keypair-1550139395',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:27:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-bw70m0dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:27:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=73d95044-495c-4254-b14b-3a02c1c1dfd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "address": "fa:16:3e:d5:aa:d8", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb76e6a59-56", "ovs_interfaceid": "b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG os_vif [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb76e6a59-56, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6665aa21-2ae6-4460-a84c-f8a3d037a895) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:29:19 user nova-compute[74889]: INFO os_vif [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:aa:d8,bridge_name='br-int',has_traffic_filtering=True,id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb76e6a59-56')
Nov 10 12:29:19 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Deleting instance files /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8_del
Nov 10 12:29:19 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Deletion of /opt/stack/data/nova/instances/73d95044-495c-4254-b14b-3a02c1c1dfd8_del complete
Nov 10 12:29:19 user nova-compute[74889]: INFO nova.compute.manager [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 12:29:19 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:29:19 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:29:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:20 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:29:20 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Took 0.69 seconds to deallocate network for instance.
Nov 10 12:29:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-1ccaee51-ff3c-4d43-8e00-ff581627c400 req-27d8cae6-8fe3-4b27-a925-3c0bd0a8cf55 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-vif-deleted-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:29:20 user nova-compute[74889]: INFO nova.compute.manager [req-1ccaee51-ff3c-4d43-8e00-ff581627c400 req-27d8cae6-8fe3-4b27-a925-3c0bd0a8cf55 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Neutron deleted interface b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f; detaching it from the instance and deleting it from the info cache
Nov 10 12:29:20 user nova-compute[74889]: DEBUG nova.network.neutron [req-1ccaee51-ff3c-4d43-8e00-ff581627c400 req-27d8cae6-8fe3-4b27-a925-3c0bd0a8cf55 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:29:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-1ccaee51-ff3c-4d43-8e00-ff581627c400 req-27d8cae6-8fe3-4b27-a925-3c0bd0a8cf55 service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Detach interface failed, port_id=b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f, reason: Instance 73d95044-495c-4254-b14b-3a02c1c1dfd8 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:29:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:20 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:29:20 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:29:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:21 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Deleted allocations for instance 73d95044-495c-4254-b14b-3a02c1c1dfd8
Nov 10 12:29:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-b21d6836-47c3-417e-90a9-142904323f08 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.154s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:21 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:29:21 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:29:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-8c12f7f7-3148-4716-8c9f-cffa23c74dce req-bd33eda5-db4c-4d58-ac8d-78b71e144caa service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:29:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8c12f7f7-3148-4716-8c9f-cffa23c74dce req-bd33eda5-db4c-4d58-ac8d-78b71e144caa service nova] Acquiring lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8c12f7f7-3148-4716-8c9f-cffa23c74dce req-bd33eda5-db4c-4d58-ac8d-78b71e144caa service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8c12f7f7-3148-4716-8c9f-cffa23c74dce req-bd33eda5-db4c-4d58-ac8d-78b71e144caa service nova] Lock "73d95044-495c-4254-b14b-3a02c1c1dfd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-8c12f7f7-3148-4716-8c9f-cffa23c74dce req-bd33eda5-db4c-4d58-ac8d-78b71e144caa service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] No waiting events found dispatching network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:29:21 user nova-compute[74889]: WARNING nova.compute.manager [req-8c12f7f7-3148-4716-8c9f-cffa23c74dce req-bd33eda5-db4c-4d58-ac8d-78b71e144caa service nova] [instance: 73d95044-495c-4254-b14b-3a02c1c1dfd8] Received unexpected event network-vif-plugged-b76e6a59-5616-4cc6-be33-f4cbc4bfdf1f for instance with vm_state deleted and task_state None.
Nov 10 12:29:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:25 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:29:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:29:33 user nova-compute[74889]: INFO nova.compute.manager [None req-3ec8f7f4-d3c8-4a5a-b76a-94c89dc71322 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Unrescuing
Nov 10 12:29:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3ec8f7f4-d3c8-4a5a-b76a-94c89dc71322 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:29:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3ec8f7f4-d3c8-4a5a-b76a-94c89dc71322 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquired lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:29:33 user nova-compute[74889]: DEBUG nova.network.neutron [None req-3ec8f7f4-d3c8-4a5a-b76a-94c89dc71322 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG nova.network.neutron [None req-3ec8f7f4-d3c8-4a5a-b76a-94c89dc71322 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updating instance_info_cache with network_info: [{"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-3ec8f7f4-d3c8-4a5a-b76a-94c89dc71322 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Releasing lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG nova.objects.instance [None req-3ec8f7f4-d3c8-4a5a-b76a-94c89dc71322 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'flavor' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-ea904845-eed4-4da6-98c9-bf58eea8b6a5 req-24e025fc-24d5-4e79-97ef-8ae1c3ab321a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-unplugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ea904845-eed4-4da6-98c9-bf58eea8b6a5 req-24e025fc-24d5-4e79-97ef-8ae1c3ab321a service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ea904845-eed4-4da6-98c9-bf58eea8b6a5 req-24e025fc-24d5-4e79-97ef-8ae1c3ab321a service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ea904845-eed4-4da6-98c9-bf58eea8b6a5 req-24e025fc-24d5-4e79-97ef-8ae1c3ab321a service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-ea904845-eed4-4da6-98c9-bf58eea8b6a5 req-24e025fc-24d5-4e79-97ef-8ae1c3ab321a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-unplugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:29:34 user nova-compute[74889]: WARNING nova.compute.manager [req-ea904845-eed4-4da6-98c9-bf58eea8b6a5 req-24e025fc-24d5-4e79-97ef-8ae1c3ab321a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-unplugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:29:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:35 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Instance destroyed successfully.
Nov 10 12:29:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:29:36 user nova-compute[74889]: WARNING nova.compute.manager [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:29:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG nova.compute.manager [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:29:36 user nova-compute[74889]: WARNING nova.compute.manager [req-820844be-8b11-46ed-9d3d-de6ddb2cb7d3 req-9e2df366-d93c-461a-9225-cc0766f74d60 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state rescued and task_state unrescuing.
Nov 10 12:29:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-3ec8f7f4-d3c8-4a5a-b76a-94c89dc71322 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:29:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-c12e89ff-69b0-400e-8841-21c1ef6fcc65 req-c16d53ba-99ed-4054-851b-4b9139d3d599 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:29:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c12e89ff-69b0-400e-8841-21c1ef6fcc65 req-c16d53ba-99ed-4054-851b-4b9139d3d599 service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c12e89ff-69b0-400e-8841-21c1ef6fcc65 req-c16d53ba-99ed-4054-851b-4b9139d3d599 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c12e89ff-69b0-400e-8841-21c1ef6fcc65 req-c16d53ba-99ed-4054-851b-4b9139d3d599 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:38 user nova-compute[74889]: DEBUG nova.compute.manager [req-c12e89ff-69b0-400e-8841-21c1ef6fcc65 req-c16d53ba-99ed-4054-851b-4b9139d3d599 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:29:38 user nova-compute[74889]: WARNING nova.compute.manager [req-c12e89ff-69b0-400e-8841-21c1ef6fcc65 req-c16d53ba-99ed-4054-851b-4b9139d3d599 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state active and task_state None.
Nov 10 12:29:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:38 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:29:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:29:39 user nova-compute[74889]: INFO nova.compute.manager [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attaching volume 42ecb4a0-cf27-409c-ad74-6815dabdb172 to /dev/vdb
Nov 10 12:29:39 user nova-compute[74889]: DEBUG os_brick.utils [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04726a4-9f45-4390-b033-d43098d60026]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:93b9df0368d\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a46a3e-ae77-4b20-bf84-89290c85ce44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81edd21-03b1-4f05-8b81-051911d68927]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88d145b-a9f6-41d1-9762-499e1e1fb371]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Running cmd (subprocess): nvme version {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] 'nvme version' failed. Not Retrying. {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] nvme not present on system {{(pid=74889) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 12:29:39 user nova-compute[74889]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 12:29:39 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07dd56a-e4f6-44ba-ba36-939112665470]: (4, '') {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74889) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.lightos [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] LIGHTOS: no hostnqn found. {{(pid=74889) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG os_brick.utils [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:93b9df0368d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG nova.virt.block_device [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updating existing volume attachment record: 1df361f3-4648-4838-a873-572a5f27d698 {{(pid=74889) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 12:29:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:29:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Calling os-brick to attach iSCSI Volume {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXUzuieh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:30:03 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:30:03 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:30:03 user nova-compute[74889]: INFO os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95f02fb-491e-479e-8e40-b0f8b3a307e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 12:30:03 user nova-compute[74889]:  {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --interface default --op new {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[85830de7-f5dc-4870-8e1b-7bbb0f92bced]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172] added\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172] added
Nov 10 12:30:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[883b9e44-56ba-4d07-9141-7cef0de2d648]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b504259-133e-4e03-9763-f823d2f99f5f]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXUzuieh {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXUzuieh" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e28db1-3553-468a-8a60-88e5aa4f57bc]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pXUzuieh'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[836c4d66-027b-4de0-8b31-c7dae72759db]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[939bbefa-de08-46d4-bf2e-a1bb500775ef]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --login {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d63722c-7371-45c4-ab63-a8389a7abfb2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172, portal: 172.16.0.220,3260]
Nov 10 12:30:03 user nova-compute[74889]: Login to [iface: default, target: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172, portal: 172.16.0.220,3260] successful.
Nov 10 12:30:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59b9ae9-2b43-48e8-bdd2-30b476187be5]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7be936b-9559-46d5-b553-e9a3d6c9ecb8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 (non-flash)
Nov 10 12:30:03 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Connected to 172.16.0.220:3260 {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=74889) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74889) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d63ae6-6516-49cc-8a9a-14834c7f1b1e]: (4, ('- - 0', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:03 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: None {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74889) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXUzuieh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74889) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26664666139366539', 'path': '/dev/sdd'} {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664666139366539', 'path': '/dev/sdd'} {{(pid=74889) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 12:30:04 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:30:04 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:30:04 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:30:04 user nova-compute[74889]:   <serial>42ecb4a0-cf27-409c-ad74-6815dabdb172</serial>
Nov 10 12:30:04 user nova-compute[74889]: </disk>
Nov 10 12:30:04 user nova-compute[74889]:  {{(pid=74889) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:30:04 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] No VIF found with MAC fa:16:3e:bc:b5:4d, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:30:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fab7c4e-1d74-42f9-aa39-ac4416f163ef tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.998s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:30:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:30:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 12:30:06 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:07 user nova-compute[74889]: INFO nova.compute.manager [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Detaching volume 42ecb4a0-cf27-409c-ad74-6815dabdb172
Nov 10 12:30:07 user nova-compute[74889]: INFO nova.virt.block_device [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Attempting to driver detach volume 42ecb4a0-cf27-409c-ad74-6815dabdb172 from mountpoint /dev/vdb
Nov 10 12:30:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Attempting to detach device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:30:07 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:30:07 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:30:07 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:30:07 user nova-compute[74889]:   <serial>42ecb4a0-cf27-409c-ad74-6815dabdb172</serial>
Nov 10 12:30:07 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:30:07 user nova-compute[74889]: </disk>
Nov 10 12:30:07 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:30:07 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Successfully detached device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the persistent domain config.
Nov 10 12:30:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:30:07 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:30:07 user nova-compute[74889]:   <source dev="/dev/sdd"/>
Nov 10 12:30:07 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:30:07 user nova-compute[74889]:   <serial>42ecb4a0-cf27-409c-ad74-6815dabdb172</serial>
Nov 10 12:30:07 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:30:07 user nova-compute[74889]: </disk>
Nov 10 12:30:07 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:30:07 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:10 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:30:10 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=24.829627990722656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 990a099a-7893-4428-9de1-8dc217bf2fc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance bc9274ab-2362-42b1-a8af-06811513be55 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 2d444297-e40e-4030-90a7-b934eda6fbb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:30:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:30:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:30:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:12 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:30:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:30:12 user nova-compute[74889]: INFO nova.compute.claims [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Claim successful on node user
Nov 10 12:30:13 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:30:13 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:30:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG nova.policy [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b24ef2fdba14d0cbd34e08917e31ae5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547570bd00724bcaafedc05b2a266490', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:30:13 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Creating image(s)
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "/opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "/opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.198s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk 1073741824" returned: 0 in 0.050s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:13 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Successfully created port: 04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Cannot resize image /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Ensure instance console log exists: /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Successfully updated port: 04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquired lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-9f631617-e25e-403d-a488-0e58b31e6402 req-f6f2c40c-eb51-4f1d-b9a4-89ff5c47819a service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-changed-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-9f631617-e25e-403d-a488-0e58b31e6402 req-f6f2c40c-eb51-4f1d-b9a4-89ff5c47819a service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Refreshing instance network info cache due to event network-changed-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f631617-e25e-403d-a488-0e58b31e6402 req-f6f2c40c-eb51-4f1d-b9a4-89ff5c47819a service nova] Acquiring lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.network.neutron [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updating instance_info_cache with network_info: [{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Releasing lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance network_info: |[{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f631617-e25e-403d-a488-0e58b31e6402 req-f6f2c40c-eb51-4f1d-b9a4-89ff5c47819a service nova] Acquired lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.network.neutron [req-9f631617-e25e-403d-a488-0e58b31e6402 req-f6f2c40c-eb51-4f1d-b9a4-89ff5c47819a service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Refreshing network info cache for port 04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Start _get_guest_xml network_info=[{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:30:14 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:30:14 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1063501865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1063501865',id=50,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0rIMpeYMBamQ8+TDAONUlQLFfnvmqWVW0MsOaZX/hguLOq3T94e/iyzV3NuM+uGWja9ii5fEIKSM13qJH41HIQRu4BncBpXf/z3W0BjYIugmx6X9ObvPh+Lc2aucKTyg==',key_name='tempest-keypair-218763534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-3teunujr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:30:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=8a37c5ef-11e9-4dee-a2a0-297bae60d659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:30:14 user nova-compute[74889]:   <uuid>8a37c5ef-11e9-4dee-a2a0-297bae60d659</uuid>
Nov 10 12:30:14 user nova-compute[74889]:   <name>instance-00000032</name>
Nov 10 12:30:14 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:30:14 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:30:14 user nova-compute[74889]:   <metadata>
Nov 10 12:30:14 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:30:14 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:30:14 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1063501865</nova:name>
Nov 10 12:30:14 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:30:14</nova:creationTime>
Nov 10 12:30:14 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:30:14 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:30:14 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:30:14 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:30:14 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:30:14 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:30:14 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:30:14 user nova-compute[74889]:       <nova:owner>
Nov 10 12:30:14 user nova-compute[74889]:         <nova:user uuid="5b24ef2fdba14d0cbd34e08917e31ae5">tempest-AttachVolumeShelveTestJSON-651460361-project-member</nova:user>
Nov 10 12:30:14 user nova-compute[74889]:         <nova:project uuid="547570bd00724bcaafedc05b2a266490">tempest-AttachVolumeShelveTestJSON-651460361</nova:project>
Nov 10 12:30:14 user nova-compute[74889]:       </nova:owner>
Nov 10 12:30:14 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:30:14 user nova-compute[74889]:       <nova:ports>
Nov 10 12:30:14 user nova-compute[74889]:         <nova:port uuid="04b80b73-acda-4adf-b2e6-3c4e3c9cdac7">
Nov 10 12:30:14 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 12:30:14 user nova-compute[74889]:         </nova:port>
Nov 10 12:30:14 user nova-compute[74889]:       </nova:ports>
Nov 10 12:30:14 user nova-compute[74889]:     </nova:instance>
Nov 10 12:30:14 user nova-compute[74889]:   </metadata>
Nov 10 12:30:14 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:30:14 user nova-compute[74889]:     <system>
Nov 10 12:30:14 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:30:14 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:30:14 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:30:14 user nova-compute[74889]:       <entry name="serial">8a37c5ef-11e9-4dee-a2a0-297bae60d659</entry>
Nov 10 12:30:14 user nova-compute[74889]:       <entry name="uuid">8a37c5ef-11e9-4dee-a2a0-297bae60d659</entry>
Nov 10 12:30:14 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:30:14 user nova-compute[74889]:     </system>
Nov 10 12:30:14 user nova-compute[74889]:   </sysinfo>
Nov 10 12:30:14 user nova-compute[74889]:   <os>
Nov 10 12:30:14 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:30:14 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:30:14 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:30:14 user nova-compute[74889]:   </os>
Nov 10 12:30:14 user nova-compute[74889]:   <features>
Nov 10 12:30:14 user nova-compute[74889]:     <acpi/>
Nov 10 12:30:14 user nova-compute[74889]:     <apic/>
Nov 10 12:30:14 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:30:14 user nova-compute[74889]:   </features>
Nov 10 12:30:14 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:30:14 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:30:14 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:30:14 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:30:14 user nova-compute[74889]:   </clock>
Nov 10 12:30:14 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:30:14 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:30:14 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:30:14 user nova-compute[74889]:   </cpu>
Nov 10 12:30:14 user nova-compute[74889]:   <devices>
Nov 10 12:30:14 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:30:14 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:30:14 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk"/>
Nov 10 12:30:14 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:30:14 user nova-compute[74889]:     </disk>
Nov 10 12:30:14 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:30:14 user nova-compute[74889]:       <mac address="fa:16:3e:56:43:1f"/>
Nov 10 12:30:14 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:30:14 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:30:14 user nova-compute[74889]:       <target dev="tap04b80b73-ac"/>
Nov 10 12:30:14 user nova-compute[74889]:     </interface>
Nov 10 12:30:14 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:30:14 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/console.log" append="off"/>
Nov 10 12:30:14 user nova-compute[74889]:     </serial>
Nov 10 12:30:14 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:30:14 user nova-compute[74889]:     <video>
Nov 10 12:30:14 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:30:14 user nova-compute[74889]:     </video>
Nov 10 12:30:14 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:30:14 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:30:14 user nova-compute[74889]:     </rng>
Nov 10 12:30:14 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:30:14 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:30:14 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:30:14 user nova-compute[74889]:     </memballoon>
Nov 10 12:30:14 user nova-compute[74889]:   </devices>
Nov 10 12:30:14 user nova-compute[74889]: </domain>
Nov 10 12:30:14 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1063501865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1063501865',id=50,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0rIMpeYMBamQ8+TDAONUlQLFfnvmqWVW0MsOaZX/hguLOq3T94e/iyzV3NuM+uGWja9ii5fEIKSM13qJH41HIQRu4BncBpXf/z3W0BjYIugmx6X9ObvPh+Lc2aucKTyg==',key_name='tempest-keypair-218763534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-3teunujr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:30:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=8a37c5ef-11e9-4dee-a2a0-297bae60d659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG os_vif [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1115cb19-2ea5-5a00-9b03-ac203fbeda64', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04b80b73-ac, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04b80b73-ac, col_values=(('qos', UUID('98b1801e-1d8b-4369-920b-0bda237d646a')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04b80b73-ac, col_values=(('external_ids', {'iface-id': '04b80b73-acda-4adf-b2e6-3c4e3c9cdac7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:43:1f', 'vm-uuid': '8a37c5ef-11e9-4dee-a2a0-297bae60d659'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:30:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:14 user nova-compute[74889]: INFO os_vif [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac')
Nov 10 12:30:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:30:15 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] No VIF found with MAC fa:16:3e:56:43:1f, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:30:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-9f631617-e25e-403d-a488-0e58b31e6402 req-f6f2c40c-eb51-4f1d-b9a4-89ff5c47819a service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updated VIF entry in instance network info cache for port 04b80b73-acda-4adf-b2e6-3c4e3c9cdac7. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:30:15 user nova-compute[74889]: DEBUG nova.network.neutron [req-9f631617-e25e-403d-a488-0e58b31e6402 req-f6f2c40c-eb51-4f1d-b9a4-89ff5c47819a service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updating instance_info_cache with network_info: [{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:30:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9f631617-e25e-403d-a488-0e58b31e6402 req-f6f2c40c-eb51-4f1d-b9a4-89ff5c47819a service nova] Releasing lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:30:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-6bff602b-c696-456c-9af8-8e2817834e55 req-54389ec3-47cc-4583-9a92-1c7c038bb1e7 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:30:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6bff602b-c696-456c-9af8-8e2817834e55 req-54389ec3-47cc-4583-9a92-1c7c038bb1e7 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6bff602b-c696-456c-9af8-8e2817834e55 req-54389ec3-47cc-4583-9a92-1c7c038bb1e7 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6bff602b-c696-456c-9af8-8e2817834e55 req-54389ec3-47cc-4583-9a92-1c7c038bb1e7 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-6bff602b-c696-456c-9af8-8e2817834e55 req-54389ec3-47cc-4583-9a92-1c7c038bb1e7 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:30:16 user nova-compute[74889]: WARNING nova.compute.manager [req-6bff602b-c696-456c-9af8-8e2817834e55 req-54389ec3-47cc-4583-9a92-1c7c038bb1e7 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state building and task_state spawning.
Nov 10 12:30:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "bc9274ab-2362-42b1-a8af-06811513be55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:17 user nova-compute[74889]: INFO nova.compute.manager [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Terminating instance
Nov 10 12:30:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:30:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-21aa4753-c6e9-4538-89da-58a48faa9362 req-844aef17-34cc-4c25-9342-61fc2bb96ffa service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-21aa4753-c6e9-4538-89da-58a48faa9362 req-844aef17-34cc-4c25-9342-61fc2bb96ffa service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-21aa4753-c6e9-4538-89da-58a48faa9362 req-844aef17-34cc-4c25-9342-61fc2bb96ffa service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-21aa4753-c6e9-4538-89da-58a48faa9362 req-844aef17-34cc-4c25-9342-61fc2bb96ffa service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-21aa4753-c6e9-4538-89da-58a48faa9362 req-844aef17-34cc-4c25-9342-61fc2bb96ffa service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-21aa4753-c6e9-4538-89da-58a48faa9362 req-844aef17-34cc-4c25-9342-61fc2bb96ffa service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-unplugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:30:18 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance spawned successfully.
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:30:18 user nova-compute[74889]: INFO nova.compute.manager [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-848b06e9-c8d9-4dbf-b0f4-94ffd81bf014 req-82baf436-7bba-49f6-adca-5ae1bc87d915 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-848b06e9-c8d9-4dbf-b0f4-94ffd81bf014 req-82baf436-7bba-49f6-adca-5ae1bc87d915 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-848b06e9-c8d9-4dbf-b0f4-94ffd81bf014 req-82baf436-7bba-49f6-adca-5ae1bc87d915 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-848b06e9-c8d9-4dbf-b0f4-94ffd81bf014 req-82baf436-7bba-49f6-adca-5ae1bc87d915 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-848b06e9-c8d9-4dbf-b0f4-94ffd81bf014 req-82baf436-7bba-49f6-adca-5ae1bc87d915 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:30:18 user nova-compute[74889]: WARNING nova.compute.manager [req-848b06e9-c8d9-4dbf-b0f4-94ffd81bf014 req-82baf436-7bba-49f6-adca-5ae1bc87d915 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state building and task_state spawning.
Nov 10 12:30:18 user nova-compute[74889]: INFO nova.compute.manager [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Took 5.76 seconds to build instance.
Nov 10 12:30:18 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Instance destroyed successfully.
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.objects.instance [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'resources' on Instance uuid bc9274ab-2362-42b1-a8af-06811513be55 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1fb84d59-d0cb-4406-afbb-a5ad73b11333 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.881s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1717297090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1717297090',id=48,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-91amqoxz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:28:32Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=bc9274ab-2362-42b1-a8af-06811513be55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "address": "fa:16:3e:f2:36:50", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f385cdf-45", "ovs_interfaceid": "0f385cdf-45ca-4c25-8627-d1c23437ae5e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:36:50,bridge_name='br-int',has_traffic_filtering=True,id=0f385cdf-45ca-4c25-8627-d1c23437ae5e,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f385cdf-45') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_vif [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:36:50,bridge_name='br-int',has_traffic_filtering=True,id=0f385cdf-45ca-4c25-8627-d1c23437ae5e,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f385cdf-45') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f385cdf-45, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4de7b523-1994-4ce1-a4f7-ea8f3270fc16) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:18 user nova-compute[74889]: INFO os_vif [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:36:50,bridge_name='br-int',has_traffic_filtering=True,id=0f385cdf-45ca-4c25-8627-d1c23437ae5e,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f385cdf-45')
Nov 10 12:30:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnmorNbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:30:18 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[569da996-47b4-4fb1-909a-b8f4d004a4fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:30:18 user nova-compute[74889]: No targets found.
Nov 10 12:30:18 user nova-compute[74889]: iSNS:
Nov 10 12:30:18 user nova-compute[74889]: No targets found.
Nov 10 12:30:18 user nova-compute[74889]: STATIC:
Nov 10 12:30:18 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273
Nov 10 12:30:18 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:30:18 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:30:18 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534
Nov 10 12:30:18 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:30:18 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:30:18 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:30:18 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:30:18 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:30:18 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172
Nov 10 12:30:18 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:30:18 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:30:18 user nova-compute[74889]: FIRMWARE:
Nov 10 12:30:18 user nova-compute[74889]: No targets found.
Nov 10 12:30:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:30:18 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:30:18 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c890b6-649d-45e9-86f3-a9355f92af5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a9a80e-edc1-43e6-962f-61b760772c66]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:30:18 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:30:18 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:30:18 user nova-compute[74889]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 (non-flash)
Nov 10 12:30:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:30:18 user nova-compute[74889]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 (non-flash)
Nov 10 12:30:18 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:30:18 user nova-compute[74889]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 (non-flash)
Nov 10 12:30:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3881a4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273'): ({'sdc'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Removing single pathed devices sdc {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe2c4bb-c204-4305-8ce2-de1f92f12d52]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4256c9b-e48b-4581-bd4b-715e3a87dd31]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flushing IO for device /dev/sdc {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5fd776-da94-4c10-96d5-c112ea1d6227]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb8982-68c6-4a2a-b5bd-facf586c52a0]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] SCSI volumes sdc have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f79b1d8-a9b3-48d1-bd58-7d72dd2ce885]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae631d2-c3b1-43b1-a542-ea776e291417]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273, portal: 172.16.0.220,3260]
Nov 10 12:30:18 user nova-compute[74889]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273, portal: 172.16.0.220,3260] successful.
Nov 10 12:30:18 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:19 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41f28e7d-9fa0-41a9-931a-42cdbb823273 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:19 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3fcab2-519f-489d-a7a5-d5e1a18e1458]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:30:19 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] <== disconnect_volume: return (336ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:30:19 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:30:19 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Deleting instance files /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55_del
Nov 10 12:30:19 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Deletion of /opt/stack/data/nova/instances/bc9274ab-2362-42b1-a8af-06811513be55_del complete
Nov 10 12:30:19 user nova-compute[74889]: INFO nova.compute.manager [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 10 12:30:19 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:30:19 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:30:19 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: bc9274ab-2362-42b1-a8af-06811513be55] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:30:19 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:30:19 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Took 0.42 seconds to deallocate network for instance.
Nov 10 12:30:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-6a296e57-bc77-4a31-a83d-21f2258c0cec req-ce62b560-e032-4427-820b-fda40cd92eed service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:30:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6a296e57-bc77-4a31-a83d-21f2258c0cec req-ce62b560-e032-4427-820b-fda40cd92eed service nova] Acquiring lock "bc9274ab-2362-42b1-a8af-06811513be55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6a296e57-bc77-4a31-a83d-21f2258c0cec req-ce62b560-e032-4427-820b-fda40cd92eed service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-6a296e57-bc77-4a31-a83d-21f2258c0cec req-ce62b560-e032-4427-820b-fda40cd92eed service nova] Lock "bc9274ab-2362-42b1-a8af-06811513be55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-6a296e57-bc77-4a31-a83d-21f2258c0cec req-ce62b560-e032-4427-820b-fda40cd92eed service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] No waiting events found dispatching network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:30:20 user nova-compute[74889]: WARNING nova.compute.manager [req-6a296e57-bc77-4a31-a83d-21f2258c0cec req-ce62b560-e032-4427-820b-fda40cd92eed service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received unexpected event network-vif-plugged-0f385cdf-45ca-4c25-8627-d1c23437ae5e for instance with vm_state active and task_state deleting.
Nov 10 12:30:20 user nova-compute[74889]: INFO nova.compute.manager [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Took 1.05 seconds to detach 1 volumes for instance.
Nov 10 12:30:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:30:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:30:20 user nova-compute[74889]: DEBUG nova.compute.manager [req-22a479a1-3ad5-44af-975d-bfe6cedaeabc req-4a9928b7-fcc2-4ddb-bd2a-06290bd85249 service nova] [instance: bc9274ab-2362-42b1-a8af-06811513be55] Received event network-vif-deleted-0f385cdf-45ca-4c25-8627-d1c23437ae5e {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:30:20 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:30:20 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:30:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:20 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Deleted allocations for instance bc9274ab-2362-42b1-a8af-06811513be55
Nov 10 12:30:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-1b779367-7a45-48cc-b836-14714d3fe858 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "bc9274ab-2362-42b1-a8af-06811513be55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.202s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:22 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:30:22 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:30:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:27 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d58137e4-403b-45af-b9fc-64a2c5efe819 is timed out.
Nov 10 12:30:27 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Successfully detached device vdb from instance d58137e4-403b-45af-b9fc-64a2c5efe819 from the live domain config.
Nov 10 12:30:27 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXUzuieh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:30:27 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[605cbc95-efde-456a-8bda-475abe1b5428]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:30:27 user nova-compute[74889]: No targets found.
Nov 10 12:30:27 user nova-compute[74889]: iSNS:
Nov 10 12:30:27 user nova-compute[74889]: No targets found.
Nov 10 12:30:27 user nova-compute[74889]: STATIC:
Nov 10 12:30:27 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534
Nov 10 12:30:27 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:30:27 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:30:27 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:30:27 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:30:27 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:30:27 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172
Nov 10 12:30:27 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:30:27 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:30:27 user nova-compute[74889]: FIRMWARE:
Nov 10 12:30:27 user nova-compute[74889]: No targets found.
Nov 10 12:30:27 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:30:27 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:30:27 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[695addc8-f4fb-4875-b468-150cee87d5fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e68ce5b-64dc-4b13-ba64-c175475fc70d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:30:27 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:30:27 user nova-compute[74889]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 (non-flash)
Nov 10 12:30:27 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:30:27 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:30:27 user nova-compute[74889]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 (non-flash)
Nov 10 12:30:27 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3884ece50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172'): ({'sdd'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Removing single pathed devices sdd {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd35be15-b7a5-499c-b62c-5db079e43148]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f86cfe-7860-45b1-bc05-49c5381b7146]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Flushing IO for device /dev/sdd {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379694e-40a8-4ccb-9608-6a7df142db67]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:30:27 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[802a113e-603b-4971-a4a8-bbc13da837b2]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] SCSI volumes sdd have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24770ec-fb3b-4ebe-a8c4-bf0b27acb9ce]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fa5d7f-cf20-4688-a8e0-9c28917d7236]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172, portal: 172.16.0.220,3260]
Nov 10 12:30:28 user nova-compute[74889]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172, portal: 172.16.0.220,3260] successful.
Nov 10 12:30:28 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42ecb4a0-cf27-409c-ad74-6815dabdb172 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b1279e-01b0-473c-8ef0-e1ba8c49b024]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] <== disconnect_volume: return (323ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:30:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:30:29 user nova-compute[74889]: DEBUG nova.objects.instance [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'flavor' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:30:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-edf1fa62-c9cd-4897-8997-fabb0932a9d8 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.982s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:30:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:30:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:30:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:30:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:30:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:30:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:05 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:31:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:31:05 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:31:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:31:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:31:05 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:31:05 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid 662a3c8c-e0b0-4dea-b620-d11de1c5a92e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:31:06 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updating instance_info_cache with network_info: [{"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:31:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-662a3c8c-e0b0-4dea-b620-d11de1c5a92e" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:31:06 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:08 user nova-compute[74889]: INFO nova.compute.manager [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Terminating instance
Nov 10 12:31:08 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG nova.compute.manager [req-c1dc3169-f07f-4d3e-8d49-4d5109f9cb33 req-795f78b6-441e-4c60-a778-2e47d3f13587 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-vif-unplugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1dc3169-f07f-4d3e-8d49-4d5109f9cb33 req-795f78b6-441e-4c60-a778-2e47d3f13587 service nova] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1dc3169-f07f-4d3e-8d49-4d5109f9cb33 req-795f78b6-441e-4c60-a778-2e47d3f13587 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c1dc3169-f07f-4d3e-8d49-4d5109f9cb33 req-795f78b6-441e-4c60-a778-2e47d3f13587 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG nova.compute.manager [req-c1dc3169-f07f-4d3e-8d49-4d5109f9cb33 req-795f78b6-441e-4c60-a778-2e47d3f13587 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] No waiting events found dispatching network-vif-unplugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG nova.compute.manager [req-c1dc3169-f07f-4d3e-8d49-4d5109f9cb33 req-795f78b6-441e-4c60-a778-2e47d3f13587 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-vif-unplugged-63459792-78b7-4048-8711-69fb4afaf388 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Instance destroyed successfully.
Nov 10 12:31:09 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'resources' on Instance uuid 990a099a-7893-4428-9de1-8dc217bf2fc0 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:20:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1358922037',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1358922037',id=45,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:21:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-o0awf097',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:22:53Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=990a099a-7893-4428-9de1-8dc217bf2fc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "63459792-78b7-4048-8711-69fb4afaf388", "address": "fa:16:3e:b5:76:40", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63459792-78", "ovs_interfaceid": "63459792-78b7-4048-8711-69fb4afaf388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:76:40,bridge_name='br-int',has_traffic_filtering=True,id=63459792-78b7-4048-8711-69fb4afaf388,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63459792-78') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG os_vif [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:76:40,bridge_name='br-int',has_traffic_filtering=True,id=63459792-78b7-4048-8711-69fb4afaf388,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63459792-78') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63459792-78, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a50017c-b5d4-4d67-a980-8532386328e6) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:09 user nova-compute[74889]: INFO os_vif [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:76:40,bridge_name='br-int',has_traffic_filtering=True,id=63459792-78b7-4048-8711-69fb4afaf388,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63459792-78')
Nov 10 12:31:09 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Deleting instance files /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0_del
Nov 10 12:31:09 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Deletion of /opt/stack/data/nova/instances/990a099a-7893-4428-9de1-8dc217bf2fc0_del complete
Nov 10 12:31:09 user nova-compute[74889]: INFO nova.compute.manager [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 10 12:31:09 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74889) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:31:10 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Took 0.90 seconds to deallocate network for instance.
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] No waiting events found dispatching network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:31:11 user nova-compute[74889]: WARNING nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received unexpected event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 for instance with vm_state deleted and task_state None.
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] No waiting events found dispatching network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:31:11 user nova-compute[74889]: WARNING nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received unexpected event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 for instance with vm_state deleted and task_state None.
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] No waiting events found dispatching network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:31:11 user nova-compute[74889]: WARNING nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received unexpected event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 for instance with vm_state deleted and task_state None.
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-vif-unplugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] No waiting events found dispatching network-vif-unplugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:31:11 user nova-compute[74889]: WARNING nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received unexpected event network-vif-unplugged-63459792-78b7-4048-8711-69fb4afaf388 for instance with vm_state deleted and task_state None.
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Acquiring lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] No waiting events found dispatching network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:31:11 user nova-compute[74889]: WARNING nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received unexpected event network-vif-plugged-63459792-78b7-4048-8711-69fb4afaf388 for instance with vm_state deleted and task_state None.
Nov 10 12:31:11 user nova-compute[74889]: DEBUG nova.compute.manager [req-ead1d2b2-e4e1-437d-a933-be9fcc2efffd req-c65c7ce9-414e-4db2-8dec-914c6842d4f0 service nova] [instance: 990a099a-7893-4428-9de1-8dc217bf2fc0] Received event network-vif-deleted-63459792-78b7-4048-8711-69fb4afaf388 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:31:11 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Deleted allocations for instance 990a099a-7893-4428-9de1-8dc217bf2fc0
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9fd4b9d2-a88b-4f3d-a9b8-7532a456d105 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "990a099a-7893-4428-9de1-8dc217bf2fc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.455s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:12 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Error from libvirt while getting description of instance-0000002d: [Error Code 42] Domain not found: no domain with matching uuid '990a099a-7893-4428-9de1-8dc217bf2fc0' (instance-0000002d): libvirt.libvirtError: Domain not found: no domain with matching uuid '990a099a-7893-4428-9de1-8dc217bf2fc0' (instance-0000002d)
Nov 10 12:31:12 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:31:12 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:31:12 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8210MB free_disk=24.896697998046875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 7f361287-3a8c-4422-992d-709d48c7c663 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 2d444297-e40e-4030-90a7-b934eda6fbb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 8a37c5ef-11e9-4dee-a2a0-297bae60d659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:31:12 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:31:13 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:31:13 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:31:13 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:31:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:31:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:31:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:31:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:24 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:31:24 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:31:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:31:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:31:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:31:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:31:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-d329d3f4-82d4-4082-b39c-6942a60d92db req-195f0c87-882f-4e91-a223-e38d1666e720 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-changed-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:31:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-d329d3f4-82d4-4082-b39c-6942a60d92db req-195f0c87-882f-4e91-a223-e38d1666e720 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Refreshing instance network info cache due to event network-changed-986baf45-7347-40ae-81d3-a36a1fd1eb55. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:31:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d329d3f4-82d4-4082-b39c-6942a60d92db req-195f0c87-882f-4e91-a223-e38d1666e720 service nova] Acquiring lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:31:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d329d3f4-82d4-4082-b39c-6942a60d92db req-195f0c87-882f-4e91-a223-e38d1666e720 service nova] Acquired lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:31:25 user nova-compute[74889]: DEBUG nova.network.neutron [req-d329d3f4-82d4-4082-b39c-6942a60d92db req-195f0c87-882f-4e91-a223-e38d1666e720 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Refreshing network info cache for port 986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:31:25 user nova-compute[74889]: DEBUG nova.network.neutron [req-d329d3f4-82d4-4082-b39c-6942a60d92db req-195f0c87-882f-4e91-a223-e38d1666e720 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updated VIF entry in instance network info cache for port 986baf45-7347-40ae-81d3-a36a1fd1eb55. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:31:25 user nova-compute[74889]: DEBUG nova.network.neutron [req-d329d3f4-82d4-4082-b39c-6942a60d92db req-195f0c87-882f-4e91-a223-e38d1666e720 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updating instance_info_cache with network_info: [{"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:31:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-d329d3f4-82d4-4082-b39c-6942a60d92db req-195f0c87-882f-4e91-a223-e38d1666e720 service nova] Releasing lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:31:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:26 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:26 user nova-compute[74889]: INFO nova.compute.manager [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Detaching volume 0cc09d65-0f08-4041-974e-8b867af7f534
Nov 10 12:31:26 user nova-compute[74889]: INFO nova.virt.block_device [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Attempting to driver detach volume 0cc09d65-0f08-4041-974e-8b867af7f534 from mountpoint /dev/vdb
Nov 10 12:31:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Attempting to detach device vdb from instance 2d444297-e40e-4030-90a7-b934eda6fbb6 from the persistent domain config. {{(pid=74889) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 12:31:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:31:26 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:31:26 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:31:26 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:31:26 user nova-compute[74889]:   <serial>0cc09d65-0f08-4041-974e-8b867af7f534</serial>
Nov 10 12:31:26 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:31:26 user nova-compute[74889]: </disk>
Nov 10 12:31:26 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:31:26 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Successfully detached device vdb from instance 2d444297-e40e-4030-90a7-b934eda6fbb6 from the persistent domain config.
Nov 10 12:31:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2d444297-e40e-4030-90a7-b934eda6fbb6 from the live domain config. {{(pid=74889) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 12:31:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.guest [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 12:31:26 user nova-compute[74889]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 12:31:26 user nova-compute[74889]:   <source dev="/dev/sde"/>
Nov 10 12:31:26 user nova-compute[74889]:   <target dev="vdb" bus="virtio"/>
Nov 10 12:31:26 user nova-compute[74889]:   <serial>0cc09d65-0f08-4041-974e-8b867af7f534</serial>
Nov 10 12:31:26 user nova-compute[74889]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 12:31:26 user nova-compute[74889]: </disk>
Nov 10 12:31:26 user nova-compute[74889]:  {{(pid=74889) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 12:31:26 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:31:26 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 12:31:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-c5669b5a-dcdb-42bb-9690-d797e732119c req-0ad37c4f-605f-42b8-8532-a6f3a7b4727a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-changed-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:31:27 user nova-compute[74889]: DEBUG nova.compute.manager [req-c5669b5a-dcdb-42bb-9690-d797e732119c req-0ad37c4f-605f-42b8-8532-a6f3a7b4727a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Refreshing instance network info cache due to event network-changed-986baf45-7347-40ae-81d3-a36a1fd1eb55. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:31:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c5669b5a-dcdb-42bb-9690-d797e732119c req-0ad37c4f-605f-42b8-8532-a6f3a7b4727a service nova] Acquiring lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:31:27 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c5669b5a-dcdb-42bb-9690-d797e732119c req-0ad37c4f-605f-42b8-8532-a6f3a7b4727a service nova] Acquired lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:31:27 user nova-compute[74889]: DEBUG nova.network.neutron [req-c5669b5a-dcdb-42bb-9690-d797e732119c req-0ad37c4f-605f-42b8-8532-a6f3a7b4727a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Refreshing network info cache for port 986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:31:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-c5669b5a-dcdb-42bb-9690-d797e732119c req-0ad37c4f-605f-42b8-8532-a6f3a7b4727a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updated VIF entry in instance network info cache for port 986baf45-7347-40ae-81d3-a36a1fd1eb55. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:31:28 user nova-compute[74889]: DEBUG nova.network.neutron [req-c5669b5a-dcdb-42bb-9690-d797e732119c req-0ad37c4f-605f-42b8-8532-a6f3a7b4727a service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updating instance_info_cache with network_info: [{"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:31:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-c5669b5a-dcdb-42bb-9690-d797e732119c req-0ad37c4f-605f-42b8-8532-a6f3a7b4727a service nova] Releasing lock "refresh_cache-2d444297-e40e-4030-90a7-b934eda6fbb6" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:31:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:46 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2d444297-e40e-4030-90a7-b934eda6fbb6 is timed out.
Nov 10 12:31:46 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Successfully detached device vdb from instance 2d444297-e40e-4030-90a7-b934eda6fbb6 from the live domain config.
Nov 10 12:31:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkToQwJl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:31:46 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[119d0a56-8f58-4a47-8496-175a3af01be9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:31:46 user nova-compute[74889]: No targets found.
Nov 10 12:31:46 user nova-compute[74889]: iSNS:
Nov 10 12:31:46 user nova-compute[74889]: No targets found.
Nov 10 12:31:46 user nova-compute[74889]: STATIC:
Nov 10 12:31:46 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534
Nov 10 12:31:46 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:31:46 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:31:46 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:31:46 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:31:46 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:31:46 user nova-compute[74889]: FIRMWARE:
Nov 10 12:31:46 user nova-compute[74889]: No targets found.
Nov 10 12:31:46 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:31:46 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:31:46 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e63ac1b-b5ad-4591-ab01-5f8646944379]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfba6a2e-0f57-4fb8-bf0a-fdc406cce572]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:31:46 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:31:46 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:31:46 user nova-compute[74889]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 (non-flash)
Nov 10 12:31:46 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3a0091b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534'): ({'sde'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Removing single pathed devices sde {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5020e4db-b702-46cc-9899-d52e4074033b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee7ac42-bb17-4ccf-9953-14413cc8f626]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Flushing IO for device /dev/sde {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdcbc7e-3a30-4519-a2e8-9a1b258dbb7a]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c0d63e-b19c-4823-94b0-903ef56d7bcd]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] SCSI volumes sde have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[be55994b-6213-4213-ace9-251affc862de]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[79969799-d8bd-40fc-bd26-3c3feb76d532]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534, portal: 172.16.0.220,3260]
Nov 10 12:31:46 user nova-compute[74889]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534, portal: 172.16.0.220,3260] successful.
Nov 10 12:31:46 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0cc09d65-0f08-4041-974e-8b867af7f534 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a59470-d518-464b-9d97-8359da7ab289]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] <== disconnect_volume: return (287ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:31:46 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:31:47 user nova-compute[74889]: DEBUG nova.objects.instance [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'flavor' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:31:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a9fe4f4c-805c-4677-a6d1-38e49ffc6cfb tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.824s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:31:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "7f361287-3a8c-4422-992d-709d48c7c663" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:59 user nova-compute[74889]: INFO nova.compute.manager [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Terminating instance
Nov 10 12:31:59 user nova-compute[74889]: DEBUG nova.compute.manager [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-8a1cb1a6-23e1-4127-84f1-54e5d37c05bd req-733d7f81-61c7-47e3-bde4-4c33bc9dcd36 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8a1cb1a6-23e1-4127-84f1-54e5d37c05bd req-733d7f81-61c7-47e3-bde4-4c33bc9dcd36 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8a1cb1a6-23e1-4127-84f1-54e5d37c05bd req-733d7f81-61c7-47e3-bde4-4c33bc9dcd36 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8a1cb1a6-23e1-4127-84f1-54e5d37c05bd req-733d7f81-61c7-47e3-bde4-4c33bc9dcd36 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-8a1cb1a6-23e1-4127-84f1-54e5d37c05bd req-733d7f81-61c7-47e3-bde4-4c33bc9dcd36 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG nova.compute.manager [req-8a1cb1a6-23e1-4127-84f1-54e5d37c05bd req-733d7f81-61c7-47e3-bde4-4c33bc9dcd36 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:31:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Instance destroyed successfully.
Nov 10 12:32:00 user nova-compute[74889]: DEBUG nova.objects.instance [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'resources' on Instance uuid 7f361287-3a8c-4422-992d-709d48c7c663 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:15:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-733470210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-733470210',id=39,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:17:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-hi0cjmad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:19:09Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=7f361287-3a8c-4422-992d-709d48c7c663,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "address": "fa:16:3e:69:40:f3", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b04c830-c6", "ovs_interfaceid": "3b04c830-c64d-4813-9b99-a80a2f87cec6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:40:f3,bridge_name='br-int',has_traffic_filtering=True,id=3b04c830-c64d-4813-9b99-a80a2f87cec6,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b04c830-c6') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_vif [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:40:f3,bridge_name='br-int',has_traffic_filtering=True,id=3b04c830-c64d-4813-9b99-a80a2f87cec6,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b04c830-c6') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b04c830-c6, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e34901e-8e50-4e23-9f35-5007780b1947) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: INFO os_vif [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:40:f3,bridge_name='br-int',has_traffic_filtering=True,id=3b04c830-c64d-4813-9b99-a80a2f87cec6,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b04c830-c6')
Nov 10 12:32:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] calling os-brick to detach iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fa3a0067100>, {'target_iqn': 'iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vEZCKAdD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 12:32:00 user nova-compute[74889]: WARNING os_brick.initiator.connectors.base [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7cb5e5-e1e4-4991-a729-293d09bb7109]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 12:32:00 user nova-compute[74889]: No targets found.
Nov 10 12:32:00 user nova-compute[74889]: iSNS:
Nov 10 12:32:00 user nova-compute[74889]: No targets found.
Nov 10 12:32:00 user nova-compute[74889]: STATIC:
Nov 10 12:32:00 user nova-compute[74889]: Target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05
Nov 10 12:32:00 user nova-compute[74889]:         Portal: 172.16.0.220:3260,-1
Nov 10 12:32:00 user nova-compute[74889]:                 Iface Name: default
Nov 10 12:32:00 user nova-compute[74889]: FIRMWARE:
Nov 10 12:32:00 user nova-compute[74889]: No targets found.
Nov 10 12:32:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 12:32:00 user nova-compute[74889]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 12:32:00 user nova-compute[74889]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74889) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05', 0)] {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[7373ef1c-0c86-4118-b94a-6c2df53e426a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6636bb-aa08-44d7-a687-5029e2eca387]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:32:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 (non-flash)
Nov 10 12:32:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fa3885e17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05'): ({'sdb'}, set())}) {{(pid=74889) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Removing single pathed devices sdb {{(pid=74889) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e6c329-871c-407e-aa9f-04aac2f8abe6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c6de2b-f6d9-4800-b8ff-a1f79d163674]: (4, ('ok\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Flushing IO for device /dev/sdb {{(pid=74889) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[604e0c84-d9a4-4fd2-a7b6-9a117c82dc87]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74889) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a681442-2d8c-4eea-ac1d-79580e5975f4]: (4, ('1', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.linuxscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] SCSI volumes sdb have been removed. {{(pid=74889) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05')] {{(pid=74889) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9f909f-6e4d-44db-b510-247cb9617e65]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --logout {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[4163c1c0-0264-403e-8166-6360c50611da]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05, portal: 172.16.0.220,3260]
Nov 10 12:32:00 user nova-compute[74889]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05, portal: 172.16.0.220,3260] successful.
Nov 10 12:32:00 user nova-compute[74889]:  stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op delete {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ce2b95f-67fb-47fe-a193-87bb6e114f05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85601) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fa92c6-8189-4384-be5f-cb0747567013]: (4, ('', '')) {{(pid=85601) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74889) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.base [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG os_brick.initiator.connectors.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] <== disconnect_volume: return (314ms) None {{(pid=74889) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG nova.virt.libvirt.volume.iscsi [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Disconnected iSCSI Volume {{(pid=74889) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 12:32:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Deleting instance files /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663_del
Nov 10 12:32:00 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Deletion of /opt/stack/data/nova/instances/7f361287-3a8c-4422-992d-709d48c7c663_del complete
Nov 10 12:32:00 user nova-compute[74889]: INFO nova.compute.manager [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 10 12:32:00 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:32:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:32:01 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Took 0.62 seconds to deallocate network for instance.
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:01 user nova-compute[74889]: WARNING nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state active and task_state deleting.
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:01 user nova-compute[74889]: WARNING nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state active and task_state deleting.
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:01 user nova-compute[74889]: WARNING nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state active and task_state deleting.
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-unplugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Acquiring lock "7f361287-3a8c-4422-992d-709d48c7c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] Lock "7f361287-3a8c-4422-992d-709d48c7c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] No waiting events found dispatching network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:01 user nova-compute[74889]: WARNING nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received unexpected event network-vif-plugged-3b04c830-c64d-4813-9b99-a80a2f87cec6 for instance with vm_state active and task_state deleting.
Nov 10 12:32:01 user nova-compute[74889]: DEBUG nova.compute.manager [req-a72bb1f9-9c44-4c0b-b575-62b787d5a0f1 req-04bc8fd4-0d97-48eb-8229-ffd871c3e2a8 service nova] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Received event network-vif-deleted-3b04c830-c64d-4813-9b99-a80a2f87cec6 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-900044db-fcec-4b9b-9f69-b4d0e19b0da1 req-542f78fd-479a-4568-ae53-ff7464357e13 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-changed-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:04 user nova-compute[74889]: DEBUG nova.compute.manager [req-900044db-fcec-4b9b-9f69-b4d0e19b0da1 req-542f78fd-479a-4568-ae53-ff7464357e13 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Refreshing instance network info cache due to event network-changed-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:32:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-900044db-fcec-4b9b-9f69-b4d0e19b0da1 req-542f78fd-479a-4568-ae53-ff7464357e13 service nova] Acquiring lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:32:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-900044db-fcec-4b9b-9f69-b4d0e19b0da1 req-542f78fd-479a-4568-ae53-ff7464357e13 service nova] Acquired lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:32:04 user nova-compute[74889]: DEBUG nova.network.neutron [req-900044db-fcec-4b9b-9f69-b4d0e19b0da1 req-542f78fd-479a-4568-ae53-ff7464357e13 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Refreshing network info cache for port 04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:32:04 user nova-compute[74889]: DEBUG nova.network.neutron [req-900044db-fcec-4b9b-9f69-b4d0e19b0da1 req-542f78fd-479a-4568-ae53-ff7464357e13 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updated VIF entry in instance network info cache for port 04b80b73-acda-4adf-b2e6-3c4e3c9cdac7. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:32:04 user nova-compute[74889]: DEBUG nova.network.neutron [req-900044db-fcec-4b9b-9f69-b4d0e19b0da1 req-542f78fd-479a-4568-ae53-ff7464357e13 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updating instance_info_cache with network_info: [{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:32:04 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-900044db-fcec-4b9b-9f69-b4d0e19b0da1 req-542f78fd-479a-4568-ae53-ff7464357e13 service nova] Releasing lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:32:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:07 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:07 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:32:07 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Skipping network cache update for instance because it is being deleted. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 10 12:32:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:32:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:32:07 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:32:07 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updating instance_info_cache with network_info: [{"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:32:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-de32b888-15ed-42eb-9029-1cb3dc471253" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:32:07 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:32:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:08 user nova-compute[74889]: INFO nova.compute.manager [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 7f361287-3a8c-4422-992d-709d48c7c663] Took 7.59 seconds to detach 1 volumes for instance.
Nov 10 12:32:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:09 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:32:09 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:32:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:09 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Deleted allocations for instance 7f361287-3a8c-4422-992d-709d48c7c663
Nov 10 12:32:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-208da5b4-3a5d-4ea3-bc52-b3363a255cbb tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "7f361287-3a8c-4422-992d-709d48c7c663" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.960s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:11 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:11 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:32:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:11 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:12 user nova-compute[74889]: INFO nova.compute.manager [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Shelving
Nov 10 12:32:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-8d423a7d-bea7-456a-98cc-706d1fab6fc9 req-224a2ac8-99c9-4af1-8017-04f7d646b4b1 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8d423a7d-bea7-456a-98cc-706d1fab6fc9 req-224a2ac8-99c9-4af1-8017-04f7d646b4b1 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8d423a7d-bea7-456a-98cc-706d1fab6fc9 req-224a2ac8-99c9-4af1-8017-04f7d646b4b1 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8d423a7d-bea7-456a-98cc-706d1fab6fc9 req-224a2ac8-99c9-4af1-8017-04f7d646b4b1 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG nova.compute.manager [req-8d423a7d-bea7-456a-98cc-706d1fab6fc9 req-224a2ac8-99c9-4af1-8017-04f7d646b4b1 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:12 user nova-compute[74889]: WARNING nova.compute.manager [req-8d423a7d-bea7-456a-98cc-706d1fab6fc9 req-224a2ac8-99c9-4af1-8017-04f7d646b4b1 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state active and task_state shelving.
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:13 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance destroyed successfully.
Nov 10 12:32:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:13 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Beginning cold snapshot process
Nov 10 12:32:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk /opt/stack/data/nova/instances/snapshots/tmpkogp6319/4ca11ae1ddcc47fb9039fae7da2cc33b {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.426s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:32:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk /opt/stack/data/nova/instances/snapshots/tmpkogp6319/4ca11ae1ddcc47fb9039fae7da2cc33b" returned: 0 in 0.817s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:14 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Snapshot extracted, beginning image upload
Nov 10 12:32:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:15 user nova-compute[74889]: WARNING nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:15 user nova-compute[74889]: WARNING nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:15 user nova-compute[74889]: WARNING nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:15 user nova-compute[74889]: WARNING nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:15 user nova-compute[74889]: WARNING nova.compute.manager [req-e5c92a2e-0c0e-410b-83bc-da0652aef19b req-4ceb081f-1168-4d35-aead-ec269413b877 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 12:32:15 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:32:15 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8379MB free_disk=24.922691345214844GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance d58137e4-403b-45af-b9fc-64a2c5efe819 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 2d444297-e40e-4030-90a7-b934eda6fbb6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 8a37c5ef-11e9-4dee-a2a0-297bae60d659 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:32:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:16 user nova-compute[74889]: INFO nova.compute.manager [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Terminating instance
Nov 10 12:32:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-242a5bd1-50df-4cb9-8b16-512771bca9c1 req-4b97d3a9-a109-4831-8f61-089c6f8b21cf service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-unplugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-242a5bd1-50df-4cb9-8b16-512771bca9c1 req-4b97d3a9-a109-4831-8f61-089c6f8b21cf service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-242a5bd1-50df-4cb9-8b16-512771bca9c1 req-4b97d3a9-a109-4831-8f61-089c6f8b21cf service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-242a5bd1-50df-4cb9-8b16-512771bca9c1 req-4b97d3a9-a109-4831-8f61-089c6f8b21cf service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-242a5bd1-50df-4cb9-8b16-512771bca9c1 req-4b97d3a9-a109-4831-8f61-089c6f8b21cf service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-unplugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-242a5bd1-50df-4cb9-8b16-512771bca9c1 req-4b97d3a9-a109-4831-8f61-089c6f8b21cf service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-unplugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:32:16 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Snapshot image upload complete
Nov 10 12:32:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:32:17 user nova-compute[74889]: INFO nova.compute.manager [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Shelve offloading
Nov 10 12:32:17 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance destroyed successfully.
Nov 10 12:32:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquired lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG nova.network.neutron [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:32:17 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Instance destroyed successfully.
Nov 10 12:32:17 user nova-compute[74889]: DEBUG nova.objects.instance [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'resources' on Instance uuid 2d444297-e40e-4030-90a7-b934eda6fbb6 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:25:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2118297203',display_name='tempest-ServerRescueNegativeTestJSON-server-2118297203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2118297203',id=49,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8JrWJfsnCMq/p+fZnn0MmDRW/cQ2ks9/NQlTsYsc3MwL6GMJYodz/XgnmHBD9v23FxsV+LGd8yLrA9FsiMiAELpz7414q/TrallGPqcEt5fwkwwiQTUFAlB12DIkq1aw==',key_name='tempest-keypair-676962485',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:27:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-zzkqnust',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:29:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=2d444297-e40e-4030-90a7-b934eda6fbb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "address": "fa:16:3e:dd:ba:c5", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986baf45-73", "ovs_interfaceid": "986baf45-7347-40ae-81d3-a36a1fd1eb55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:ba:c5,bridge_name='br-int',has_traffic_filtering=True,id=986baf45-7347-40ae-81d3-a36a1fd1eb55,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986baf45-73') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG os_vif [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:ba:c5,bridge_name='br-int',has_traffic_filtering=True,id=986baf45-7347-40ae-81d3-a36a1fd1eb55,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986baf45-73') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap986baf45-73, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3926dcb1-b4c1-4e81-a20a-38545807b74b) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:17 user nova-compute[74889]: INFO os_vif [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:ba:c5,bridge_name='br-int',has_traffic_filtering=True,id=986baf45-7347-40ae-81d3-a36a1fd1eb55,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986baf45-73')
Nov 10 12:32:17 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Deleting instance files /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6_del
Nov 10 12:32:17 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Deletion of /opt/stack/data/nova/instances/2d444297-e40e-4030-90a7-b934eda6fbb6_del complete
Nov 10 12:32:17 user nova-compute[74889]: INFO nova.compute.manager [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 10 12:32:17 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG nova.network.neutron [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updating instance_info_cache with network_info: [{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:32:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Releasing lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:32:18 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance destroyed successfully.
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.objects.instance [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'resources' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1063501865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1063501865',id=50,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0rIMpeYMBamQ8+TDAONUlQLFfnvmqWVW0MsOaZX/hguLOq3T94e/iyzV3NuM+uGWja9ii5fEIKSM13qJH41HIQRu4BncBpXf/z3W0BjYIugmx6X9ObvPh+Lc2aucKTyg==',key_name='tempest-keypair-218763534',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-3teunujr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member',shelved_at='2023-11-10T12:32:16.997849',shelved_host='user',shelved_image_id='ef3a2d09-3d75-4809-990f-10d32f99d47a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=8a37c5ef-11e9-4dee-a2a0-297bae60d659,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG os_vif [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04b80b73-ac, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98b1801e-1d8b-4369-920b-0bda237d646a) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:18 user nova-compute[74889]: INFO os_vif [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac')
Nov 10 12:32:18 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Deleting instance files /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659_del
Nov 10 12:32:18 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Deletion of /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659_del complete
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:32:18 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Took 0.91 seconds to deallocate network for instance.
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-2363ef7d-cfe4-4e38-bcd7-0b01610d615c req-a4d56354-7518-4406-b774-df573c8e5aeb service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-deleted-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:18 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Deleted allocations for instance 8a37c5ef-11e9-4dee-a2a0-297bae60d659
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.112s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.objects.instance [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.objects.base [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Object Instance<8a37c5ef-11e9-4dee-a2a0-297bae60d659> lazy-loaded attributes: resources,numa_topology {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:32:18 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Deleted allocations for instance 2d444297-e40e-4030-90a7-b934eda6fbb6
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d424d8bd-194d-4907-b861-bdfb3c2816ac tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.200s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-fa9b13b0-a82e-42fe-a51b-fc6249a909a1 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.415s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-bed302a4-da5f-41d4-8f13-865bb9063500 req-61b944a7-d4ba-44af-b240-4f3feef0dab0 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bed302a4-da5f-41d4-8f13-865bb9063500 req-61b944a7-d4ba-44af-b240-4f3feef0dab0 service nova] Acquiring lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bed302a4-da5f-41d4-8f13-865bb9063500 req-61b944a7-d4ba-44af-b240-4f3feef0dab0 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-bed302a4-da5f-41d4-8f13-865bb9063500 req-61b944a7-d4ba-44af-b240-4f3feef0dab0 service nova] Lock "2d444297-e40e-4030-90a7-b934eda6fbb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:18 user nova-compute[74889]: DEBUG nova.compute.manager [req-bed302a4-da5f-41d4-8f13-865bb9063500 req-61b944a7-d4ba-44af-b240-4f3feef0dab0 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] No waiting events found dispatching network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:18 user nova-compute[74889]: WARNING nova.compute.manager [req-bed302a4-da5f-41d4-8f13-865bb9063500 req-61b944a7-d4ba-44af-b240-4f3feef0dab0 service nova] [instance: 2d444297-e40e-4030-90a7-b934eda6fbb6] Received unexpected event network-vif-plugged-986baf45-7347-40ae-81d3-a36a1fd1eb55 for instance with vm_state deleted and task_state None.
Nov 10 12:32:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:20 user nova-compute[74889]: INFO nova.compute.manager [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Terminating instance
Nov 10 12:32:20 user nova-compute[74889]: DEBUG nova.compute.manager [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:32:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-239fc4c6-01a8-4b73-9c32-1c2373cbe683 req-a0d9b936-ab43-4d34-90d4-db740046432d service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received event network-vif-unplugged-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-239fc4c6-01a8-4b73-9c32-1c2373cbe683 req-a0d9b936-ab43-4d34-90d4-db740046432d service nova] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-239fc4c6-01a8-4b73-9c32-1c2373cbe683 req-a0d9b936-ab43-4d34-90d4-db740046432d service nova] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-239fc4c6-01a8-4b73-9c32-1c2373cbe683 req-a0d9b936-ab43-4d34-90d4-db740046432d service nova] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-239fc4c6-01a8-4b73-9c32-1c2373cbe683 req-a0d9b936-ab43-4d34-90d4-db740046432d service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] No waiting events found dispatching network-vif-unplugged-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-239fc4c6-01a8-4b73-9c32-1c2373cbe683 req-a0d9b936-ab43-4d34-90d4-db740046432d service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received event network-vif-unplugged-8821cea2-782e-4541-9656-f70486df1363 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:21 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Instance destroyed successfully.
Nov 10 12:32:21 user nova-compute[74889]: DEBUG nova.objects.instance [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lazy-loading 'resources' on Instance uuid d58137e4-403b-45af-b9fc-64a2c5efe819 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:22:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1854413385',display_name='tempest-SnapshotDataIntegrityTests-server-1854413385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1854413385',id=46,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgycwc9Hr2kws4TmupzPTSqYSSJvAcdhL6+GCoBlrOaQzE95qEObbIlmeraCXTvl2meEHOmI8c+ioVF343D/pDd8hDKpJDNYBcw66jeX6TwUDz0Ov6fCQi0CO3znZYuyw==',key_name='tempest-keypair-240464443',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:22:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bbe1c66261049f39c0a3e03a6069b71',ramdisk_id='',reservation_id='r-w06wa2ig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1016155408',owner_user_name='tempest-SnapshotDataIntegrityTests-1016155408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:22:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7fd9b849c90c4f9e9adff2e895652d5a',uuid=d58137e4-403b-45af-b9fc-64a2c5efe819,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Converting VIF {"id": "8821cea2-782e-4541-9656-f70486df1363", "address": "fa:16:3e:bc:b5:4d", "network": {"id": "1335036a-403c-40bb-be37-30c90856d35f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-221219593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bbe1c66261049f39c0a3e03a6069b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8821cea2-78", "ovs_interfaceid": "8821cea2-782e-4541-9656-f70486df1363", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:b5:4d,bridge_name='br-int',has_traffic_filtering=True,id=8821cea2-782e-4541-9656-f70486df1363,network=Network(1335036a-403c-40bb-be37-30c90856d35f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821cea2-78') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG os_vif [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:b5:4d,bridge_name='br-int',has_traffic_filtering=True,id=8821cea2-782e-4541-9656-f70486df1363,network=Network(1335036a-403c-40bb-be37-30c90856d35f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821cea2-78') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8821cea2-78, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8452d6e-5c29-45fe-b443-7b9f8596e631) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:21 user nova-compute[74889]: INFO os_vif [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:b5:4d,bridge_name='br-int',has_traffic_filtering=True,id=8821cea2-782e-4541-9656-f70486df1363,network=Network(1335036a-403c-40bb-be37-30c90856d35f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8821cea2-78')
Nov 10 12:32:21 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Deleting instance files /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819_del
Nov 10 12:32:21 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Deletion of /opt/stack/data/nova/instances/d58137e4-403b-45af-b9fc-64a2c5efe819_del complete
Nov 10 12:32:21 user nova-compute[74889]: INFO nova.compute.manager [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 10 12:32:21 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:32:21 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:32:22 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:32:22 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Took 0.79 seconds to deallocate network for instance.
Nov 10 12:32:22 user nova-compute[74889]: DEBUG nova.compute.manager [req-e24772a4-5dfa-42fe-8f3a-1e135052bd2f req-48a8d274-0ce8-41c4-8448-9811a98ec62a service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received event network-vif-deleted-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:22 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:32:22 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:32:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:22 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Deleted allocations for instance d58137e4-403b-45af-b9fc-64a2c5efe819
Nov 10 12:32:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-f54c72f3-1ca3-42f9-8779-de9ddaf45e90 tempest-SnapshotDataIntegrityTests-1016155408 tempest-SnapshotDataIntegrityTests-1016155408-project-member] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.131s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-ede2e28f-9a89-4d5e-8b52-173cb239bee1 req-2de6c332-1a08-4ec7-aa2c-018fb9f43f86 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received event network-vif-plugged-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ede2e28f-9a89-4d5e-8b52-173cb239bee1 req-2de6c332-1a08-4ec7-aa2c-018fb9f43f86 service nova] Acquiring lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ede2e28f-9a89-4d5e-8b52-173cb239bee1 req-2de6c332-1a08-4ec7-aa2c-018fb9f43f86 service nova] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ede2e28f-9a89-4d5e-8b52-173cb239bee1 req-2de6c332-1a08-4ec7-aa2c-018fb9f43f86 service nova] Lock "d58137e4-403b-45af-b9fc-64a2c5efe819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-ede2e28f-9a89-4d5e-8b52-173cb239bee1 req-2de6c332-1a08-4ec7-aa2c-018fb9f43f86 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] No waiting events found dispatching network-vif-plugged-8821cea2-782e-4541-9656-f70486df1363 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:23 user nova-compute[74889]: WARNING nova.compute.manager [req-ede2e28f-9a89-4d5e-8b52-173cb239bee1 req-2de6c332-1a08-4ec7-aa2c-018fb9f43f86 service nova] [instance: d58137e4-403b-45af-b9fc-64a2c5efe819] Received unexpected event network-vif-plugged-8821cea2-782e-4541-9656-f70486df1363 for instance with vm_state deleted and task_state None.
Nov 10 12:32:23 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:23 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 12:32:25 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:32:25 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:32:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:32:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:32:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:32:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:32:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:32:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:32:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:50 user nova-compute[74889]: INFO nova.compute.manager [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Terminating instance
Nov 10 12:32:50 user nova-compute[74889]: DEBUG nova.compute.manager [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-3f910d97-e282-46e0-882f-c39d693053de req-40213e68-4e0d-4a33-a510-45808e3771e1 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-vif-unplugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3f910d97-e282-46e0-882f-c39d693053de req-40213e68-4e0d-4a33-a510-45808e3771e1 service nova] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3f910d97-e282-46e0-882f-c39d693053de req-40213e68-4e0d-4a33-a510-45808e3771e1 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3f910d97-e282-46e0-882f-c39d693053de req-40213e68-4e0d-4a33-a510-45808e3771e1 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-3f910d97-e282-46e0-882f-c39d693053de req-40213e68-4e0d-4a33-a510-45808e3771e1 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] No waiting events found dispatching network-vif-unplugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-3f910d97-e282-46e0-882f-c39d693053de req-40213e68-4e0d-4a33-a510-45808e3771e1 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-vif-unplugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Instance destroyed successfully.
Nov 10 12:32:50 user nova-compute[74889]: DEBUG nova.objects.instance [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lazy-loading 'resources' on Instance uuid 662a3c8c-e0b0-4dea-b620-d11de1c5a92e {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:11:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-592346711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-592346711',id=35,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:11:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='757eef88e9c04404a1ddedfa23b6031d',ramdisk_id='',reservation_id='r-nhdc88ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:13:30Z,user_data=None,user_id='4c2a48cfc9e04a2dbd2ad51b70c8b114',uuid=662a3c8c-e0b0-4dea-b620-d11de1c5a92e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converting VIF {"id": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "address": "fa:16:3e:82:06:48", "network": {"id": "d4bc5040-7a5d-4398-8da5-dc7fe22984ad", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1445285810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "757eef88e9c04404a1ddedfa23b6031d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf19c2cc5-bf", "ovs_interfaceid": "f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:06:48,bridge_name='br-int',has_traffic_filtering=True,id=f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19c2cc5-bf') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG os_vif [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:06:48,bridge_name='br-int',has_traffic_filtering=True,id=f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19c2cc5-bf') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf19c2cc5-bf, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f287e9b-4fed-41a8-8962-0133a9ff20c2) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:32:50 user nova-compute[74889]: INFO os_vif [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:06:48,bridge_name='br-int',has_traffic_filtering=True,id=f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065,network=Network(d4bc5040-7a5d-4398-8da5-dc7fe22984ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf19c2cc5-bf')
Nov 10 12:32:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Deleting instance files /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e_del
Nov 10 12:32:50 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Deletion of /opt/stack/data/nova/instances/662a3c8c-e0b0-4dea-b620-d11de1c5a92e_del complete
Nov 10 12:32:51 user nova-compute[74889]: INFO nova.compute.manager [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 12:32:51 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:32:51 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Took 0.77 seconds to deallocate network for instance.
Nov 10 12:32:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-edd5db6e-0a5e-4a50-9b42-053da875b8e7 req-96d86ced-4429-42cd-9ef7-73fa37c8d116 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-vif-deleted-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:51 user nova-compute[74889]: INFO nova.compute.manager [req-edd5db6e-0a5e-4a50-9b42-053da875b8e7 req-96d86ced-4429-42cd-9ef7-73fa37c8d116 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Neutron deleted interface f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065; detaching it from the instance and deleting it from the info cache
Nov 10 12:32:51 user nova-compute[74889]: DEBUG nova.network.neutron [req-edd5db6e-0a5e-4a50-9b42-053da875b8e7 req-96d86ced-4429-42cd-9ef7-73fa37c8d116 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG nova.compute.manager [req-edd5db6e-0a5e-4a50-9b42-053da875b8e7 req-96d86ced-4429-42cd-9ef7-73fa37c8d116 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Detach interface failed, port_id=f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065, reason: Instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:51 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:52 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Deleted allocations for instance 662a3c8c-e0b0-4dea-b620-d11de1c5a92e
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-374a99d0-22a4-4e2b-a194-db43553645f5 tempest-ServerBootFromVolumeStableRescueTest-1484079705 tempest-ServerBootFromVolumeStableRescueTest-1484079705-project-member] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.217s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] No waiting events found dispatching network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:52 user nova-compute[74889]: WARNING nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received unexpected event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 for instance with vm_state deleted and task_state None.
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] No waiting events found dispatching network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:52 user nova-compute[74889]: WARNING nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received unexpected event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 for instance with vm_state deleted and task_state None.
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] No waiting events found dispatching network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:52 user nova-compute[74889]: WARNING nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received unexpected event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 for instance with vm_state deleted and task_state None.
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-vif-unplugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] No waiting events found dispatching network-vif-unplugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:52 user nova-compute[74889]: WARNING nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received unexpected event network-vif-unplugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 for instance with vm_state deleted and task_state None.
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Acquiring lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] Lock "662a3c8c-e0b0-4dea-b620-d11de1c5a92e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:32:52 user nova-compute[74889]: DEBUG nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] No waiting events found dispatching network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:32:52 user nova-compute[74889]: WARNING nova.compute.manager [req-956c341f-fb06-4e13-a54a-1bea955f030a req-4a004a8b-9ec2-43bc-a32b-878344b04b95 service nova] [instance: 662a3c8c-e0b0-4dea-b620-d11de1c5a92e] Received unexpected event network-vif-plugged-f19c2cc5-bfac-4f8f-891d-ee1cdb0aa065 for instance with vm_state deleted and task_state None.
Nov 10 12:32:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:33:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:33:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:33:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:33:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:33:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:33:08 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:33:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:33:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:33:08 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:33:08 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updating instance_info_cache with network_info: [{"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:33:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-3824b4fa-25e2-436d-87d8-762353765644" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:33:08 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:33:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:33:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:33:10 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:33:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:33:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:33:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:33:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:33:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:33:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:33:13 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:33:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:33:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:33:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:33:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:33:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:33:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:33:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:33:14 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:33:14 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:33:14 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8758MB free_disk=25.081119537353516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:33:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:33:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 3824b4fa-25e2-436d-87d8-762353765644 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing inventories for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating ProviderTree inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing aggregate associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, aggregates: None {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing trait associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:33:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:33:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:33:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:33:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:33:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:33:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:26 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:33:26 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:33:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:33:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:33:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:33:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:33:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:33:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3824b4fa-25e2-436d-87d8-762353765644" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:33:31 user nova-compute[74889]: INFO nova.compute.manager [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Terminating instance
Nov 10 12:33:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-afe3ad06-10ba-4000-8034-778a236ca6c5 req-c1d18e2e-7225-4021-9bbf-5cba8913e940 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-vif-unplugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-afe3ad06-10ba-4000-8034-778a236ca6c5 req-c1d18e2e-7225-4021-9bbf-5cba8913e940 service nova] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-afe3ad06-10ba-4000-8034-778a236ca6c5 req-c1d18e2e-7225-4021-9bbf-5cba8913e940 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-afe3ad06-10ba-4000-8034-778a236ca6c5 req-c1d18e2e-7225-4021-9bbf-5cba8913e940 service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-afe3ad06-10ba-4000-8034-778a236ca6c5 req-c1d18e2e-7225-4021-9bbf-5cba8913e940 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] No waiting events found dispatching network-vif-unplugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG nova.compute.manager [req-afe3ad06-10ba-4000-8034-778a236ca6c5 req-c1d18e2e-7225-4021-9bbf-5cba8913e940 service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-vif-unplugged-66f57458-b8da-4024-bff4-6985155568a7 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Instance destroyed successfully.
Nov 10 12:33:32 user nova-compute[74889]: DEBUG nova.objects.instance [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'resources' on Instance uuid 3824b4fa-25e2-436d-87d8-762353765644 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-128065686',display_name='tempest-ServerRescueNegativeTestJSON-server-128065686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-128065686',id=42,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:18:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-vw8fbr6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:18:43Z,user_data=None,user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=3824b4fa-25e2-436d-87d8-762353765644,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "66f57458-b8da-4024-bff4-6985155568a7", "address": "fa:16:3e:03:61:9b", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66f57458-b8", "ovs_interfaceid": "66f57458-b8da-4024-bff4-6985155568a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:61:9b,bridge_name='br-int',has_traffic_filtering=True,id=66f57458-b8da-4024-bff4-6985155568a7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f57458-b8') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG os_vif [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:61:9b,bridge_name='br-int',has_traffic_filtering=True,id=66f57458-b8da-4024-bff4-6985155568a7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f57458-b8') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66f57458-b8, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e07b617-0efe-4248-ae74-0b6d785a454f) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:33:32 user nova-compute[74889]: INFO os_vif [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:61:9b,bridge_name='br-int',has_traffic_filtering=True,id=66f57458-b8da-4024-bff4-6985155568a7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66f57458-b8')
Nov 10 12:33:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Deleting instance files /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644_del
Nov 10 12:33:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Deletion of /opt/stack/data/nova/instances/3824b4fa-25e2-436d-87d8-762353765644_del complete
Nov 10 12:33:32 user nova-compute[74889]: INFO nova.compute.manager [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 10 12:33:32 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 3824b4fa-25e2-436d-87d8-762353765644] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:33:32 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Took 0.44 seconds to deallocate network for instance.
Nov 10 12:33:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:33:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:33:32 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Deleted allocations for instance 3824b4fa-25e2-436d-87d8-762353765644
Nov 10 12:33:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-9d11bf51-e247-469f-b594-8bc512d0bf95 tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "3824b4fa-25e2-436d-87d8-762353765644" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.827s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:33:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-9e84ef3e-580d-43bb-8ed4-895927126d81 req-1ae6a349-40d1-4b25-88cc-44f89e71a65e service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:33:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e84ef3e-580d-43bb-8ed4-895927126d81 req-1ae6a349-40d1-4b25-88cc-44f89e71a65e service nova] Acquiring lock "3824b4fa-25e2-436d-87d8-762353765644-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:33:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e84ef3e-580d-43bb-8ed4-895927126d81 req-1ae6a349-40d1-4b25-88cc-44f89e71a65e service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:33:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-9e84ef3e-580d-43bb-8ed4-895927126d81 req-1ae6a349-40d1-4b25-88cc-44f89e71a65e service nova] Lock "3824b4fa-25e2-436d-87d8-762353765644-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:33:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-9e84ef3e-580d-43bb-8ed4-895927126d81 req-1ae6a349-40d1-4b25-88cc-44f89e71a65e service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] No waiting events found dispatching network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:33:33 user nova-compute[74889]: WARNING nova.compute.manager [req-9e84ef3e-580d-43bb-8ed4-895927126d81 req-1ae6a349-40d1-4b25-88cc-44f89e71a65e service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received unexpected event network-vif-plugged-66f57458-b8da-4024-bff4-6985155568a7 for instance with vm_state deleted and task_state None.
Nov 10 12:33:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-9e84ef3e-580d-43bb-8ed4-895927126d81 req-1ae6a349-40d1-4b25-88cc-44f89e71a65e service nova] [instance: 3824b4fa-25e2-436d-87d8-762353765644] Received event network-vif-deleted-66f57458-b8da-4024-bff4-6985155568a7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:33:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:33:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:33:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:34:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:05 user nova-compute[74889]: INFO nova.compute.manager [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Unshelving
Nov 10 12:34:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:05 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:05 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'pci_requests' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:34:05 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:34:05 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:34:05 user nova-compute[74889]: INFO nova.compute.claims [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Claim successful on node user
Nov 10 12:34:05 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:34:05 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:34:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:06 user nova-compute[74889]: INFO nova.network.neutron [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updating port 04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 12:34:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:34:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquired lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:34:06 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:34:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-5a7b091e-5bb9-4f7b-86b8-eeb8c636cc4d req-132e34e4-a79d-4181-9e56-ceab9b5060bd service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-changed-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:34:06 user nova-compute[74889]: DEBUG nova.compute.manager [req-5a7b091e-5bb9-4f7b-86b8-eeb8c636cc4d req-132e34e4-a79d-4181-9e56-ceab9b5060bd service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Refreshing instance network info cache due to event network-changed-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:34:06 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5a7b091e-5bb9-4f7b-86b8-eeb8c636cc4d req-132e34e4-a79d-4181-9e56-ceab9b5060bd service nova] Acquiring lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG nova.network.neutron [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updating instance_info_cache with network_info: [{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Releasing lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:34:07 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Creating image(s)
Nov 10 12:34:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "/opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "/opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5a7b091e-5bb9-4f7b-86b8-eeb8c636cc4d req-132e34e4-a79d-4181-9e56-ceab9b5060bd service nova] Acquired lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG nova.network.neutron [req-5a7b091e-5bb9-4f7b-86b8-eeb8c636cc4d req-132e34e4-a79d-4181-9e56-ceab9b5060bd service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Refreshing network info cache for port 04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG nova.objects.base [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Object Instance<8a37c5ef-11e9-4dee-a2a0-297bae60d659> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:07 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f.part --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f.part --force-share --output=json" returned: 0 in 0.192s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG nova.virt.images [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] ef3a2d09-3d75-4809-990f-10d32f99d47a was qcow2, converting to raw {{(pid=74889) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG nova.privsep.utils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74889) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f.part /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f.converted {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG nova.network.neutron [req-5a7b091e-5bb9-4f7b-86b8-eeb8c636cc4d req-132e34e4-a79d-4181-9e56-ceab9b5060bd service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updated VIF entry in instance network info cache for port 04b80b73-acda-4adf-b2e6-3c4e3c9cdac7. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG nova.network.neutron [req-5a7b091e-5bb9-4f7b-86b8-eeb8c636cc4d req-132e34e4-a79d-4181-9e56-ceab9b5060bd service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updating instance_info_cache with network_info: [{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-5a7b091e-5bb9-4f7b-86b8-eeb8c636cc4d req-132e34e4-a79d-4181-9e56-ceab9b5060bd service nova] Releasing lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:34:08 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f.part /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f.converted" returned: 0 in 0.781s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f.converted --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updating instance_info_cache with network_info: [{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.193s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f --force-share --output=json" returned: 0 in 0.165s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f --force-share --output=json" returned: 0 in 0.170s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f,backing_fmt=raw /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f,backing_fmt=raw /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk 1073741824" returned: 0 in 0.057s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:09 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b7d22cacf0625e80c87cd1524ea73a0a05dbc1f --force-share --output=json" returned: 0 in 0.169s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:10 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'migration_context' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:34:10 user nova-compute[74889]: DEBUG nova.objects.base [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Object Instance<8a37c5ef-11e9-4dee-a2a0-297bae60d659> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:34:10 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Rebasing disk image.
Nov 10 12:34:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:10 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a -F raw /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:34:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a -F raw /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk" returned: 0 in 2.428s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Ensure instance console log exists: /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Start _get_guest_xml network_info=[{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8b4af91e8f58ba4a017172ef3ff92d44',container_format='bare',created_at=2023-11-10T12:32:12Z,direct_url=<?>,disk_format='qcow2',id=ef3a2d09-3d75-4809-990f-10d32f99d47a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1063501865-shelved',owner='547570bd00724bcaafedc05b2a266490',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T12:32:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:34:12 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:34:12 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8b4af91e8f58ba4a017172ef3ff92d44',container_format='bare',created_at=2023-11-10T12:32:12Z,direct_url=<?>,disk_format='qcow2',id=ef3a2d09-3d75-4809-990f-10d32f99d47a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1063501865-shelved',owner='547570bd00724bcaafedc05b2a266490',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T12:32:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.objects.base [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Object Instance<8a37c5ef-11e9-4dee-a2a0-297bae60d659> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T12:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1063501865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1063501865',id=50,image_ref='ef3a2d09-3d75-4809-990f-10d32f99d47a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-218763534',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-3teunujr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member',shelved_at='2023-11-10T12:32:16.997849',shelved_host='user',shelved_image_id='ef3a2d09-3d75-4809-990f-10d32f99d47a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:34:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=8a37c5ef-11e9-4dee-a2a0-297bae60d659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.objects.instance [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.objects.base [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Object Instance<8a37c5ef-11e9-4dee-a2a0-297bae60d659> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74889) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:34:12 user nova-compute[74889]:   <uuid>8a37c5ef-11e9-4dee-a2a0-297bae60d659</uuid>
Nov 10 12:34:12 user nova-compute[74889]:   <name>instance-00000032</name>
Nov 10 12:34:12 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:34:12 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:34:12 user nova-compute[74889]:   <metadata>
Nov 10 12:34:12 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:34:12 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:34:12 user nova-compute[74889]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1063501865</nova:name>
Nov 10 12:34:12 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:34:12</nova:creationTime>
Nov 10 12:34:12 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:34:12 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:34:12 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:34:12 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:34:12 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:34:12 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:34:12 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:34:12 user nova-compute[74889]:       <nova:owner>
Nov 10 12:34:12 user nova-compute[74889]:         <nova:user uuid="5b24ef2fdba14d0cbd34e08917e31ae5">tempest-AttachVolumeShelveTestJSON-651460361-project-member</nova:user>
Nov 10 12:34:12 user nova-compute[74889]:         <nova:project uuid="547570bd00724bcaafedc05b2a266490">tempest-AttachVolumeShelveTestJSON-651460361</nova:project>
Nov 10 12:34:12 user nova-compute[74889]:       </nova:owner>
Nov 10 12:34:12 user nova-compute[74889]:       <nova:root type="image" uuid="ef3a2d09-3d75-4809-990f-10d32f99d47a"/>
Nov 10 12:34:12 user nova-compute[74889]:       <nova:ports>
Nov 10 12:34:12 user nova-compute[74889]:         <nova:port uuid="04b80b73-acda-4adf-b2e6-3c4e3c9cdac7">
Nov 10 12:34:12 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 12:34:12 user nova-compute[74889]:         </nova:port>
Nov 10 12:34:12 user nova-compute[74889]:       </nova:ports>
Nov 10 12:34:12 user nova-compute[74889]:     </nova:instance>
Nov 10 12:34:12 user nova-compute[74889]:   </metadata>
Nov 10 12:34:12 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:34:12 user nova-compute[74889]:     <system>
Nov 10 12:34:12 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:34:12 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:34:12 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:34:12 user nova-compute[74889]:       <entry name="serial">8a37c5ef-11e9-4dee-a2a0-297bae60d659</entry>
Nov 10 12:34:12 user nova-compute[74889]:       <entry name="uuid">8a37c5ef-11e9-4dee-a2a0-297bae60d659</entry>
Nov 10 12:34:12 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:34:12 user nova-compute[74889]:     </system>
Nov 10 12:34:12 user nova-compute[74889]:   </sysinfo>
Nov 10 12:34:12 user nova-compute[74889]:   <os>
Nov 10 12:34:12 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:34:12 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:34:12 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:34:12 user nova-compute[74889]:   </os>
Nov 10 12:34:12 user nova-compute[74889]:   <features>
Nov 10 12:34:12 user nova-compute[74889]:     <acpi/>
Nov 10 12:34:12 user nova-compute[74889]:     <apic/>
Nov 10 12:34:12 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:34:12 user nova-compute[74889]:   </features>
Nov 10 12:34:12 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:34:12 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:34:12 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:34:12 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:34:12 user nova-compute[74889]:   </clock>
Nov 10 12:34:12 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:34:12 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:34:12 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:34:12 user nova-compute[74889]:   </cpu>
Nov 10 12:34:12 user nova-compute[74889]:   <devices>
Nov 10 12:34:12 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:34:12 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:34:12 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk"/>
Nov 10 12:34:12 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:34:12 user nova-compute[74889]:     </disk>
Nov 10 12:34:12 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:34:12 user nova-compute[74889]:       <mac address="fa:16:3e:56:43:1f"/>
Nov 10 12:34:12 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:34:12 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:34:12 user nova-compute[74889]:       <target dev="tap04b80b73-ac"/>
Nov 10 12:34:12 user nova-compute[74889]:     </interface>
Nov 10 12:34:12 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:34:12 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/console.log" append="off"/>
Nov 10 12:34:12 user nova-compute[74889]:     </serial>
Nov 10 12:34:12 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:34:12 user nova-compute[74889]:     <video>
Nov 10 12:34:12 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:34:12 user nova-compute[74889]:     </video>
Nov 10 12:34:12 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:34:12 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:34:12 user nova-compute[74889]:     </rng>
Nov 10 12:34:12 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:34:12 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:34:12 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:34:12 user nova-compute[74889]:     </memballoon>
Nov 10 12:34:12 user nova-compute[74889]:   </devices>
Nov 10 12:34:12 user nova-compute[74889]: </domain>
Nov 10 12:34:12 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T12:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1063501865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1063501865',id=50,image_ref='ef3a2d09-3d75-4809-990f-10d32f99d47a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-218763534',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:30:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-3teunujr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member',shelved_at='2023-11-10T12:32:16.997849',shelved_host='user',shelved_image_id='ef3a2d09-3d75-4809-990f-10d32f99d47a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:34:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=8a37c5ef-11e9-4dee-a2a0-297bae60d659,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG os_vif [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1115cb19-2ea5-5a00-9b03-ac203fbeda64', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04b80b73-ac, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04b80b73-ac, col_values=(('qos', UUID('5c9b8e8a-09dc-4222-b5d2-97c0029fd4a4')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04b80b73-ac, col_values=(('external_ids', {'iface-id': '04b80b73-acda-4adf-b2e6-3c4e3c9cdac7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:43:1f', 'vm-uuid': '8a37c5ef-11e9-4dee-a2a0-297bae60d659'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:34:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:12 user nova-compute[74889]: INFO os_vif [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac')
Nov 10 12:34:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:34:13 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] No VIF found with MAC fa:16:3e:56:43:1f, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-27fc0b72-3a24-4391-9231-08bb9489c7cb req-c5705b6a-47b0-47bd-9044-de1e8fed4699 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-27fc0b72-3a24-4391-9231-08bb9489c7cb req-c5705b6a-47b0-47bd-9044-de1e8fed4699 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-27fc0b72-3a24-4391-9231-08bb9489c7cb req-c5705b6a-47b0-47bd-9044-de1e8fed4699 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-27fc0b72-3a24-4391-9231-08bb9489c7cb req-c5705b6a-47b0-47bd-9044-de1e8fed4699 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG nova.compute.manager [req-27fc0b72-3a24-4391-9231-08bb9489c7cb req-c5705b6a-47b0-47bd-9044-de1e8fed4699 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:34:14 user nova-compute[74889]: WARNING nova.compute.manager [req-27fc0b72-3a24-4391-9231-08bb9489c7cb req-c5705b6a-47b0-47bd-9044-de1e8fed4699 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 12:34:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:15 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:34:15 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:34:15 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:34:15 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:34:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8864MB free_disk=24.976707458496094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:34:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance de32b888-15ed-42eb-9029-1cb3dc471253 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (07c73308-5a33-4ed2-81ea-818734657bdc): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-3f8f83dd-dcf2-4cfc-af82-ecb1e8cae028 req-605cc022-d097-4f42-bb44-468b70037391 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3f8f83dd-dcf2-4cfc-af82-ecb1e8cae028 req-605cc022-d097-4f42-bb44-468b70037391 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3f8f83dd-dcf2-4cfc-af82-ecb1e8cae028 req-605cc022-d097-4f42-bb44-468b70037391 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-3f8f83dd-dcf2-4cfc-af82-ecb1e8cae028 req-605cc022-d097-4f42-bb44-468b70037391 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.compute.manager [req-3f8f83dd-dcf2-4cfc-af82-ecb1e8cae028 req-605cc022-d097-4f42-bb44-468b70037391 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:34:16 user nova-compute[74889]: WARNING nova.compute.manager [req-3f8f83dd-dcf2-4cfc-af82-ecb1e8cae028 req-605cc022-d097-4f42-bb44-468b70037391 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:34:16 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance spawned successfully.
Nov 10 12:34:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:34:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-e6469d08-79f4-4acf-9864-f50dc554f875 tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.221s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:34:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:34:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "de32b888-15ed-42eb-9029-1cb3dc471253" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:21 user nova-compute[74889]: INFO nova.compute.manager [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Terminating instance
Nov 10 12:34:21 user nova-compute[74889]: DEBUG nova.compute.manager [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-64dda499-7bfd-4422-ba6b-eb750e1076b1 req-cd5a76a7-83c9-44ff-9dde-ce144d80229a service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-unplugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-64dda499-7bfd-4422-ba6b-eb750e1076b1 req-cd5a76a7-83c9-44ff-9dde-ce144d80229a service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-64dda499-7bfd-4422-ba6b-eb750e1076b1 req-cd5a76a7-83c9-44ff-9dde-ce144d80229a service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-64dda499-7bfd-4422-ba6b-eb750e1076b1 req-cd5a76a7-83c9-44ff-9dde-ce144d80229a service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-64dda499-7bfd-4422-ba6b-eb750e1076b1 req-cd5a76a7-83c9-44ff-9dde-ce144d80229a service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-unplugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:34:21 user nova-compute[74889]: DEBUG nova.compute.manager [req-64dda499-7bfd-4422-ba6b-eb750e1076b1 req-cd5a76a7-83c9-44ff-9dde-ce144d80229a service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-unplugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:22 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Instance destroyed successfully.
Nov 10 12:34:22 user nova-compute[74889]: DEBUG nova.objects.instance [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lazy-loading 'resources' on Instance uuid de32b888-15ed-42eb-9029-1cb3dc471253 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:16:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1387647068',display_name='tempest-ServerRescueNegativeTestJSON-server-1387647068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1387647068',id=41,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:21:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62c4b9efdfb14eadb63b747cc3c6003f',ramdisk_id='',reservation_id='r-b2yoos3z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-524488673',owner_user_name='tempest-ServerRescueNegativeTestJSON-524488673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:23:29Z,user_data=None,user_id='db6e671b33f14840b2a79a3affbbaaa8',uuid=de32b888-15ed-42eb-9029-1cb3dc471253,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converting VIF {"id": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "address": "fa:16:3e:a1:a6:69", "network": {"id": "00a2e939-cd3d-477a-86f1-514a1c3c43c7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-510582534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62c4b9efdfb14eadb63b747cc3c6003f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d2cfd53-72", "ovs_interfaceid": "9d2cfd53-72da-4fb7-bc5d-c139019fa9e7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=9d2cfd53-72da-4fb7-bc5d-c139019fa9e7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d2cfd53-72') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG os_vif [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=9d2cfd53-72da-4fb7-bc5d-c139019fa9e7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d2cfd53-72') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d2cfd53-72, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2ae2b86-414b-4810-b089-7e916d33eb1e) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:34:22 user nova-compute[74889]: INFO os_vif [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:a6:69,bridge_name='br-int',has_traffic_filtering=True,id=9d2cfd53-72da-4fb7-bc5d-c139019fa9e7,network=Network(00a2e939-cd3d-477a-86f1-514a1c3c43c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d2cfd53-72')
Nov 10 12:34:22 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Deleting instance files /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253_del
Nov 10 12:34:22 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Deletion of /opt/stack/data/nova/instances/de32b888-15ed-42eb-9029-1cb3dc471253_del complete
Nov 10 12:34:22 user nova-compute[74889]: INFO nova.compute.manager [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 12:34:22 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:34:22 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:34:23 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:34:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-e7e92049-b83a-4c81-8c81-587e9a469a5d req-523f2fed-3849-4ee3-b014-63383fc04af6 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-deleted-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:34:23 user nova-compute[74889]: INFO nova.compute.manager [req-e7e92049-b83a-4c81-8c81-587e9a469a5d req-523f2fed-3849-4ee3-b014-63383fc04af6 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Neutron deleted interface 9d2cfd53-72da-4fb7-bc5d-c139019fa9e7; detaching it from the instance and deleting it from the info cache
Nov 10 12:34:23 user nova-compute[74889]: DEBUG nova.network.neutron [req-e7e92049-b83a-4c81-8c81-587e9a469a5d req-523f2fed-3849-4ee3-b014-63383fc04af6 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:34:23 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Took 0.70 seconds to deallocate network for instance.
Nov 10 12:34:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-e7e92049-b83a-4c81-8c81-587e9a469a5d req-523f2fed-3849-4ee3-b014-63383fc04af6 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Detach interface failed, port_id=9d2cfd53-72da-4fb7-bc5d-c139019fa9e7, reason: Instance de32b888-15ed-42eb-9029-1cb3dc471253 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:34:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:23 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:34:23 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:34:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:23 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Deleted allocations for instance de32b888-15ed-42eb-9029-1cb3dc471253
Nov 10 12:34:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-c40687ee-92f2-4b39-9821-46322cfdb43f tempest-ServerRescueNegativeTestJSON-524488673 tempest-ServerRescueNegativeTestJSON-524488673-project-member] Lock "de32b888-15ed-42eb-9029-1cb3dc471253" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.992s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:24 user nova-compute[74889]: DEBUG nova.compute.manager [req-76c083f0-ad0e-4925-bdea-850c10b75b4b req-48e5d432-b28b-4d28-9519-d230f9e7aa71 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:34:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-76c083f0-ad0e-4925-bdea-850c10b75b4b req-48e5d432-b28b-4d28-9519-d230f9e7aa71 service nova] Acquiring lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:34:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-76c083f0-ad0e-4925-bdea-850c10b75b4b req-48e5d432-b28b-4d28-9519-d230f9e7aa71 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:34:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-76c083f0-ad0e-4925-bdea-850c10b75b4b req-48e5d432-b28b-4d28-9519-d230f9e7aa71 service nova] Lock "de32b888-15ed-42eb-9029-1cb3dc471253-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:34:24 user nova-compute[74889]: DEBUG nova.compute.manager [req-76c083f0-ad0e-4925-bdea-850c10b75b4b req-48e5d432-b28b-4d28-9519-d230f9e7aa71 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] No waiting events found dispatching network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:34:24 user nova-compute[74889]: WARNING nova.compute.manager [req-76c083f0-ad0e-4925-bdea-850c10b75b4b req-48e5d432-b28b-4d28-9519-d230f9e7aa71 service nova] [instance: de32b888-15ed-42eb-9029-1cb3dc471253] Received unexpected event network-vif-plugged-9d2cfd53-72da-4fb7-bc5d-c139019fa9e7 for instance with vm_state deleted and task_state None.
Nov 10 12:34:26 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:34:26 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:34:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:45 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:34:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:34:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:34:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:34:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:34:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:34:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:35:02 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:35:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:35:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:35:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:35:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:35:07 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:09 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:35:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:35:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:35:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:35:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:35:09 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:35:09 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:35:09 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updating instance_info_cache with network_info: [{"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:35:09 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-8a37c5ef-11e9-4dee-a2a0-297bae60d659" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:35:09 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:35:10 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:35:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:35:12 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:35:13 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:35:14 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:35:15 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:35:15 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:35:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8942MB free_disk=25.100200653076172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:35:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 8a37c5ef-11e9-4dee-a2a0-297bae60d659 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:35:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:35:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:35:15 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:35:15 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:35:15 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:35:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:17 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:35:17 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:35:20 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:35:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:35:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:35:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:35:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:35:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:35:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:35:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:35:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:35:27 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:28 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:35:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:35:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:35:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:37 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:42 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:47 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:52 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:55 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:55 user nova-compute[74889]: INFO nova.compute.manager [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Terminating instance
Nov 10 12:35:55 user nova-compute[74889]: DEBUG nova.compute.manager [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-970bfb83-5cb0-47cb-9c2d-81389b938222 req-3ec5b6b6-8abd-4b26-95ef-2951d37ae3fa service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-970bfb83-5cb0-47cb-9c2d-81389b938222 req-3ec5b6b6-8abd-4b26-95ef-2951d37ae3fa service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-970bfb83-5cb0-47cb-9c2d-81389b938222 req-3ec5b6b6-8abd-4b26-95ef-2951d37ae3fa service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-970bfb83-5cb0-47cb-9c2d-81389b938222 req-3ec5b6b6-8abd-4b26-95ef-2951d37ae3fa service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-970bfb83-5cb0-47cb-9c2d-81389b938222 req-3ec5b6b6-8abd-4b26-95ef-2951d37ae3fa service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG nova.compute.manager [req-970bfb83-5cb0-47cb-9c2d-81389b938222 req-3ec5b6b6-8abd-4b26-95ef-2951d37ae3fa service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Instance destroyed successfully.
Nov 10 12:35:56 user nova-compute[74889]: DEBUG nova.objects.instance [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lazy-loading 'resources' on Instance uuid 8a37c5ef-11e9-4dee-a2a0-297bae60d659 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T12:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1063501865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1063501865',id=50,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0rIMpeYMBamQ8+TDAONUlQLFfnvmqWVW0MsOaZX/hguLOq3T94e/iyzV3NuM+uGWja9ii5fEIKSM13qJH41HIQRu4BncBpXf/z3W0BjYIugmx6X9ObvPh+Lc2aucKTyg==',key_name='tempest-keypair-218763534',keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='547570bd00724bcaafedc05b2a266490',ramdisk_id='',reservation_id='r-3teunujr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-651460361',owner_user_name='tempest-AttachVolumeShelveTestJSON-651460361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:34:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b24ef2fdba14d0cbd34e08917e31ae5',uuid=8a37c5ef-11e9-4dee-a2a0-297bae60d659,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converting VIF {"id": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "address": "fa:16:3e:56:43:1f", "network": {"id": "e957e3b4-5aac-44c5-9bec-e8fcb011deab", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1926819946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547570bd00724bcaafedc05b2a266490", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04b80b73-ac", "ovs_interfaceid": "04b80b73-acda-4adf-b2e6-3c4e3c9cdac7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG os_vif [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04b80b73-ac, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c9b8e8a-09dc-4222-b5d2-97c0029fd4a4) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:35:56 user nova-compute[74889]: INFO os_vif [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:43:1f,bridge_name='br-int',has_traffic_filtering=True,id=04b80b73-acda-4adf-b2e6-3c4e3c9cdac7,network=Network(e957e3b4-5aac-44c5-9bec-e8fcb011deab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04b80b73-ac')
Nov 10 12:35:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Deleting instance files /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659_del
Nov 10 12:35:56 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Deletion of /opt/stack/data/nova/instances/8a37c5ef-11e9-4dee-a2a0-297bae60d659_del complete
Nov 10 12:35:56 user nova-compute[74889]: INFO nova.compute.manager [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 10 12:35:56 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:35:56 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:35:57 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Took 0.83 seconds to deallocate network for instance.
Nov 10 12:35:57 user nova-compute[74889]: DEBUG nova.compute.manager [req-1c8e49cf-7fe8-4692-b3be-776ca46e7ec1 req-8f82566e-41eb-450a-8a35-3b437983f33f service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-deleted-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:35:57 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:57 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Deleted allocations for instance 8a37c5ef-11e9-4dee-a2a0-297bae60d659
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-a33c8336-fd86-453d-9aa2-83557eced2fe tempest-AttachVolumeShelveTestJSON-651460361 tempest-AttachVolumeShelveTestJSON-651460361-project-member] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.160s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:35:58 user nova-compute[74889]: WARNING nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state deleted and task_state None.
Nov 10 12:35:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:35:58 user nova-compute[74889]: WARNING nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state deleted and task_state None.
Nov 10 12:35:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:35:58 user nova-compute[74889]: WARNING nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state deleted and task_state None.
Nov 10 12:35:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:35:58 user nova-compute[74889]: WARNING nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-unplugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state deleted and task_state None.
Nov 10 12:35:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Acquiring lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] Lock "8a37c5ef-11e9-4dee-a2a0-297bae60d659-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:35:58 user nova-compute[74889]: DEBUG nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] No waiting events found dispatching network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:35:58 user nova-compute[74889]: WARNING nova.compute.manager [req-a743bf96-22a2-4b2d-8e45-579a40de6e82 req-771f82fe-6b94-4348-9fdc-8b8b16fff602 service nova] [instance: 8a37c5ef-11e9-4dee-a2a0-297bae60d659] Received unexpected event network-vif-plugged-04b80b73-acda-4adf-b2e6-3c4e3c9cdac7 for instance with vm_state deleted and task_state None.
Nov 10 12:36:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:36:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:13 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:36:14 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:36:14 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:36:14 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=25.125259399414062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:36:14 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.156s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:36:15 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:36:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:36:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:36:20 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:36:21 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:36:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5011 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:36:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:36:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:36:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:36:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:41 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:46 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:36:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:51 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:36:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:36:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:36:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:36:56 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:37:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:37:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:37:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:37:01 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:37:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:37:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:37:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:37:06 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:11 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:37:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:37:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:37:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:37:11 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:13 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:37:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:37:13 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 12:37:13 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:37:16 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:37:16 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:37:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=9036MB free_disk=25.11477279663086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:37:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:20 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:21 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:22 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:23 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:23 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:25 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:26 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:27 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:27 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 12:37:27 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 12:37:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Acquiring lock "e1237b62-0de4-4a75-82bc-0f4887e98249" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:28 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:37:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:28 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:28 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:37:28 user nova-compute[74889]: INFO nova.compute.claims [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Claim successful on node user
Nov 10 12:37:29 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:37:29 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:37:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:37:29 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Creating image(s)
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "/opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "/opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG nova.policy [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c62c3d49d3941f2bd6a972d4302259d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b439cc7ac4794aba9393c43999a62189', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.195s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.184s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk 1073741824" returned: 0 in 0.049s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:37:29 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Successfully created port: e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.204s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Cannot resize image /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Ensure instance console log exists: /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Successfully updated port: e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Acquiring lock "refresh_cache-e1237b62-0de4-4a75-82bc-0f4887e98249" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Acquired lock "refresh_cache-e1237b62-0de4-4a75-82bc-0f4887e98249" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-b32cd8d9-685d-4fd1-a04d-672c18693bdd req-59f63297-a162-468b-a9c0-2813b0ab642a service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Received event network-changed-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG nova.compute.manager [req-b32cd8d9-685d-4fd1-a04d-672c18693bdd req-59f63297-a162-468b-a9c0-2813b0ab642a service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Refreshing instance network info cache due to event network-changed-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:37:30 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b32cd8d9-685d-4fd1-a04d-672c18693bdd req-59f63297-a162-468b-a9c0-2813b0ab642a service nova] Acquiring lock "refresh_cache-e1237b62-0de4-4a75-82bc-0f4887e98249" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.network.neutron [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Updating instance_info_cache with network_info: [{"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Releasing lock "refresh_cache-e1237b62-0de4-4a75-82bc-0f4887e98249" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Instance network_info: |[{"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b32cd8d9-685d-4fd1-a04d-672c18693bdd req-59f63297-a162-468b-a9c0-2813b0ab642a service nova] Acquired lock "refresh_cache-e1237b62-0de4-4a75-82bc-0f4887e98249" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-b32cd8d9-685d-4fd1-a04d-672c18693bdd req-59f63297-a162-468b-a9c0-2813b0ab642a service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Refreshing network info cache for port e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Start _get_guest_xml network_info=[{"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:37:31 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:37:31 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:37:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-86900515',display_name='tempest-VolumesActionsTest-instance-86900515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-86900515',id=51,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b439cc7ac4794aba9393c43999a62189',ramdisk_id='',reservation_id='r-rya7a6b5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-41038633',owner_user_name='tempest-VolumesActionsTest-41038633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:37:29Z,user_data=None,user_id='6c62c3d49d3941f2bd6a972d4302259d',uuid=e1237b62-0de4-4a75-82bc-0f4887e98249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Converting VIF {"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:d4:38,bridge_name='br-int',has_traffic_filtering=True,id=e9c80b7a-250c-4ebc-bf2f-6a5913cb1314,network=Network(cf66d50d-02c8-4cca-a7a3-9e33362b0b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c80b7a-25') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.objects.instance [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lazy-loading 'pci_devices' on Instance uuid e1237b62-0de4-4a75-82bc-0f4887e98249 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:37:31 user nova-compute[74889]:   <uuid>e1237b62-0de4-4a75-82bc-0f4887e98249</uuid>
Nov 10 12:37:31 user nova-compute[74889]:   <name>instance-00000033</name>
Nov 10 12:37:31 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:37:31 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:37:31 user nova-compute[74889]:   <metadata>
Nov 10 12:37:31 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:37:31 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:37:31 user nova-compute[74889]:       <nova:name>tempest-VolumesActionsTest-instance-86900515</nova:name>
Nov 10 12:37:31 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:37:31</nova:creationTime>
Nov 10 12:37:31 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:37:31 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:37:31 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:37:31 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:37:31 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:37:31 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:37:31 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:37:31 user nova-compute[74889]:       <nova:owner>
Nov 10 12:37:31 user nova-compute[74889]:         <nova:user uuid="6c62c3d49d3941f2bd6a972d4302259d">tempest-VolumesActionsTest-41038633-project-member</nova:user>
Nov 10 12:37:31 user nova-compute[74889]:         <nova:project uuid="b439cc7ac4794aba9393c43999a62189">tempest-VolumesActionsTest-41038633</nova:project>
Nov 10 12:37:31 user nova-compute[74889]:       </nova:owner>
Nov 10 12:37:31 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:37:31 user nova-compute[74889]:       <nova:ports>
Nov 10 12:37:31 user nova-compute[74889]:         <nova:port uuid="e9c80b7a-250c-4ebc-bf2f-6a5913cb1314">
Nov 10 12:37:31 user nova-compute[74889]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 12:37:31 user nova-compute[74889]:         </nova:port>
Nov 10 12:37:31 user nova-compute[74889]:       </nova:ports>
Nov 10 12:37:31 user nova-compute[74889]:     </nova:instance>
Nov 10 12:37:31 user nova-compute[74889]:   </metadata>
Nov 10 12:37:31 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:37:31 user nova-compute[74889]:     <system>
Nov 10 12:37:31 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:37:31 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:37:31 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:37:31 user nova-compute[74889]:       <entry name="serial">e1237b62-0de4-4a75-82bc-0f4887e98249</entry>
Nov 10 12:37:31 user nova-compute[74889]:       <entry name="uuid">e1237b62-0de4-4a75-82bc-0f4887e98249</entry>
Nov 10 12:37:31 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:37:31 user nova-compute[74889]:     </system>
Nov 10 12:37:31 user nova-compute[74889]:   </sysinfo>
Nov 10 12:37:31 user nova-compute[74889]:   <os>
Nov 10 12:37:31 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:37:31 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:37:31 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:37:31 user nova-compute[74889]:   </os>
Nov 10 12:37:31 user nova-compute[74889]:   <features>
Nov 10 12:37:31 user nova-compute[74889]:     <acpi/>
Nov 10 12:37:31 user nova-compute[74889]:     <apic/>
Nov 10 12:37:31 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:37:31 user nova-compute[74889]:   </features>
Nov 10 12:37:31 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:37:31 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:37:31 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:37:31 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:37:31 user nova-compute[74889]:   </clock>
Nov 10 12:37:31 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:37:31 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:37:31 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:37:31 user nova-compute[74889]:   </cpu>
Nov 10 12:37:31 user nova-compute[74889]:   <devices>
Nov 10 12:37:31 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:37:31 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:37:31 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk"/>
Nov 10 12:37:31 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:37:31 user nova-compute[74889]:     </disk>
Nov 10 12:37:31 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:37:31 user nova-compute[74889]:       <mac address="fa:16:3e:54:d4:38"/>
Nov 10 12:37:31 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:37:31 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:37:31 user nova-compute[74889]:       <target dev="tape9c80b7a-25"/>
Nov 10 12:37:31 user nova-compute[74889]:     </interface>
Nov 10 12:37:31 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:37:31 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/console.log" append="off"/>
Nov 10 12:37:31 user nova-compute[74889]:     </serial>
Nov 10 12:37:31 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:37:31 user nova-compute[74889]:     <video>
Nov 10 12:37:31 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:37:31 user nova-compute[74889]:     </video>
Nov 10 12:37:31 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:37:31 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:37:31 user nova-compute[74889]:     </rng>
Nov 10 12:37:31 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:37:31 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:37:31 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:37:31 user nova-compute[74889]:     </memballoon>
Nov 10 12:37:31 user nova-compute[74889]:   </devices>
Nov 10 12:37:31 user nova-compute[74889]: </domain>
Nov 10 12:37:31 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:37:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-86900515',display_name='tempest-VolumesActionsTest-instance-86900515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-86900515',id=51,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b439cc7ac4794aba9393c43999a62189',ramdisk_id='',reservation_id='r-rya7a6b5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-41038633',owner_user_name='tempest-VolumesActionsTest-41038633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:37:29Z,user_data=None,user_id='6c62c3d49d3941f2bd6a972d4302259d',uuid=e1237b62-0de4-4a75-82bc-0f4887e98249,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Converting VIF {"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:d4:38,bridge_name='br-int',has_traffic_filtering=True,id=e9c80b7a-250c-4ebc-bf2f-6a5913cb1314,network=Network(cf66d50d-02c8-4cca-a7a3-9e33362b0b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c80b7a-25') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG os_vif [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:d4:38,bridge_name='br-int',has_traffic_filtering=True,id=e9c80b7a-250c-4ebc-bf2f-6a5913cb1314,network=Network(cf66d50d-02c8-4cca-a7a3-9e33362b0b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c80b7a-25') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8549a16a-6165-55ff-b5f1-1e0a4a3640d8', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9c80b7a-25, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9c80b7a-25, col_values=(('qos', UUID('222a1e5c-6f24-45bf-a7fb-61824e55ee94')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9c80b7a-25, col_values=(('external_ids', {'iface-id': 'e9c80b7a-250c-4ebc-bf2f-6a5913cb1314', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:d4:38', 'vm-uuid': 'e1237b62-0de4-4a75-82bc-0f4887e98249'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:31 user nova-compute[74889]: INFO os_vif [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:d4:38,bridge_name='br-int',has_traffic_filtering=True,id=e9c80b7a-250c-4ebc-bf2f-6a5913cb1314,network=Network(cf66d50d-02c8-4cca-a7a3-9e33362b0b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c80b7a-25')
Nov 10 12:37:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] No VIF found with MAC fa:16:3e:54:d4:38, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-b32cd8d9-685d-4fd1-a04d-672c18693bdd req-59f63297-a162-468b-a9c0-2813b0ab642a service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Updated VIF entry in instance network info cache for port e9c80b7a-250c-4ebc-bf2f-6a5913cb1314. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG nova.network.neutron [req-b32cd8d9-685d-4fd1-a04d-672c18693bdd req-59f63297-a162-468b-a9c0-2813b0ab642a service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Updating instance_info_cache with network_info: [{"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:37:31 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-b32cd8d9-685d-4fd1-a04d-672c18693bdd req-59f63297-a162-468b-a9c0-2813b0ab642a service nova] Releasing lock "refresh_cache-e1237b62-0de4-4a75-82bc-0f4887e98249" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "4da432d0-e586-410c-8231-720eee5b6d5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Starting instance... {{(pid=74889) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74889) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 12:37:32 user nova-compute[74889]: INFO nova.compute.claims [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Claim successful on node user
Nov 10 12:37:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Start building networks asynchronously for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Allocating IP information in the background. {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 12:37:32 user nova-compute[74889]: DEBUG nova.network.neutron [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] allocate_for_instance() {{(pid=74889) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 12:37:32 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 12:37:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Start building block device mappings for instance. {{(pid=74889) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-10e90a27-370a-483b-ad30-5fd82fcab3de req-81672fc3-3f0e-4303-9457-77dcdae78429 service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Received event network-vif-plugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-10e90a27-370a-483b-ad30-5fd82fcab3de req-81672fc3-3f0e-4303-9457-77dcdae78429 service nova] Acquiring lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-10e90a27-370a-483b-ad30-5fd82fcab3de req-81672fc3-3f0e-4303-9457-77dcdae78429 service nova] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-10e90a27-370a-483b-ad30-5fd82fcab3de req-81672fc3-3f0e-4303-9457-77dcdae78429 service nova] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG nova.compute.manager [req-10e90a27-370a-483b-ad30-5fd82fcab3de req-81672fc3-3f0e-4303-9457-77dcdae78429 service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] No waiting events found dispatching network-vif-plugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:37:33 user nova-compute[74889]: WARNING nova.compute.manager [req-10e90a27-370a-483b-ad30-5fd82fcab3de req-81672fc3-3f0e-4303-9457-77dcdae78429 service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Received unexpected event network-vif-plugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 for instance with vm_state building and task_state spawning.
Nov 10 12:37:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Start spawning the instance on the hypervisor. {{(pid=74889) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Creating instance directory {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 12:37:33 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Creating image(s)
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Acquiring lock "/opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "/opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "/opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG nova.policy [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '335613d504d64c4fabe16232182cbabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea0a5fb0c0417c915a56fab2a0211c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74889) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.213s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Acquiring lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk 1073741824 {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a,backing_fmt=raw /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk 1073741824" returned: 0 in 0.054s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "3e6199bea6321b2237bf0bf96db3a9874bf00c7a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e6199bea6321b2237bf0bf96db3a9874bf00c7a --force-share --output=json" returned: 0 in 0.186s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk. size=1073741824 {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:37:33 user nova-compute[74889]: DEBUG nova.network.neutron [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Successfully created port: 68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.disk.api [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Cannot resize image /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk to a smaller size. {{(pid=74889) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Created local disks {{(pid=74889) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Ensure instance console log exists: /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/console.log {{(pid=74889) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.network.neutron [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Successfully updated port: 68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Acquiring lock "refresh_cache-4da432d0-e586-410c-8231-720eee5b6d5a" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Acquired lock "refresh_cache-4da432d0-e586-410c-8231-720eee5b6d5a" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.network.neutron [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Building network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-ad7c4261-45e1-48a0-8184-d1baf2ecb023 req-f3a17f23-605f-4dde-982a-4ff9b7d65f70 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-changed-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.compute.manager [req-ad7c4261-45e1-48a0-8184-d1baf2ecb023 req-f3a17f23-605f-4dde-982a-4ff9b7d65f70 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Refreshing instance network info cache due to event network-changed-68a05706-5ee9-4159-87e3-5ae063913646. {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ad7c4261-45e1-48a0-8184-d1baf2ecb023 req-f3a17f23-605f-4dde-982a-4ff9b7d65f70 service nova] Acquiring lock "refresh_cache-4da432d0-e586-410c-8231-720eee5b6d5a" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.network.neutron [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Instance cache missing network info. {{(pid=74889) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.network.neutron [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Updating instance_info_cache with network_info: [{"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Releasing lock "refresh_cache-4da432d0-e586-410c-8231-720eee5b6d5a" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.compute.manager [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Instance network_info: |[{"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74889) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ad7c4261-45e1-48a0-8184-d1baf2ecb023 req-f3a17f23-605f-4dde-982a-4ff9b7d65f70 service nova] Acquired lock "refresh_cache-4da432d0-e586-410c-8231-720eee5b6d5a" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.network.neutron [req-ad7c4261-45e1-48a0-8184-d1baf2ecb023 req-f3a17f23-605f-4dde-982a-4ff9b7d65f70 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Refreshing network info cache for port 68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Start _get_guest_xml network_info=[{"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'size': 0, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'encryption_options': None, 'image_id': 'b0074759-91cd-4b7c-8386-071a17ff617a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 12:37:34 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:37:34 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] CPU controller missing on host. {{(pid=74889) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.host [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] CPU controller found on host. {{(pid=74889) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74889) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T11:46:46Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T11:46:57Z,direct_url=<?>,disk_format='qcow2',id=b0074759-91cd-4b7c-8386-071a17ff617a,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='315f0ead5a604acb8f6af0bfa5e2a85f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T11:46:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Flavor limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Image limits 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Flavor pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Image pref 0:0:0 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Got 1 possible topologies {{(pid=74889) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.hardware [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74889) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-6474602',display_name='tempest-VolumesNegativeTest-instance-6474602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-6474602',id=52,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31ea0a5fb0c0417c915a56fab2a0211c',ramdisk_id='',reservation_id='r-xl09h3o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1976784778',owner_user_name='tempest-VolumesNegativeTest-1976784778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:37:33Z,user_data=None,user_id='335613d504d64c4fabe16232182cbabf',uuid=4da432d0-e586-410c-8231-720eee5b6d5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74889) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Converting VIF {"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c3:91,bridge_name='br-int',has_traffic_filtering=True,id=68a05706-5ee9-4159-87e3-5ae063913646,network=Network(f265c298-ef0e-47bd-974d-1379d687e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a05706-5e') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.objects.instance [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lazy-loading 'pci_devices' on Instance uuid 4da432d0-e586-410c-8231-720eee5b6d5a {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 12:37:34 user nova-compute[74889]:   <uuid>4da432d0-e586-410c-8231-720eee5b6d5a</uuid>
Nov 10 12:37:34 user nova-compute[74889]:   <name>instance-00000034</name>
Nov 10 12:37:34 user nova-compute[74889]:   <memory>524288</memory>
Nov 10 12:37:34 user nova-compute[74889]:   <vcpu>1</vcpu>
Nov 10 12:37:34 user nova-compute[74889]:   <metadata>
Nov 10 12:37:34 user nova-compute[74889]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 12:37:34 user nova-compute[74889]:       <nova:package version="0.0.0"/>
Nov 10 12:37:34 user nova-compute[74889]:       <nova:name>tempest-VolumesNegativeTest-instance-6474602</nova:name>
Nov 10 12:37:34 user nova-compute[74889]:       <nova:creationTime>2023-11-10 12:37:34</nova:creationTime>
Nov 10 12:37:34 user nova-compute[74889]:       <nova:flavor name="m1.tiny">
Nov 10 12:37:34 user nova-compute[74889]:         <nova:memory>512</nova:memory>
Nov 10 12:37:34 user nova-compute[74889]:         <nova:disk>1</nova:disk>
Nov 10 12:37:34 user nova-compute[74889]:         <nova:swap>0</nova:swap>
Nov 10 12:37:34 user nova-compute[74889]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 12:37:34 user nova-compute[74889]:         <nova:vcpus>1</nova:vcpus>
Nov 10 12:37:34 user nova-compute[74889]:       </nova:flavor>
Nov 10 12:37:34 user nova-compute[74889]:       <nova:owner>
Nov 10 12:37:34 user nova-compute[74889]:         <nova:user uuid="335613d504d64c4fabe16232182cbabf">tempest-VolumesNegativeTest-1976784778-project-member</nova:user>
Nov 10 12:37:34 user nova-compute[74889]:         <nova:project uuid="31ea0a5fb0c0417c915a56fab2a0211c">tempest-VolumesNegativeTest-1976784778</nova:project>
Nov 10 12:37:34 user nova-compute[74889]:       </nova:owner>
Nov 10 12:37:34 user nova-compute[74889]:       <nova:root type="image" uuid="b0074759-91cd-4b7c-8386-071a17ff617a"/>
Nov 10 12:37:34 user nova-compute[74889]:       <nova:ports>
Nov 10 12:37:34 user nova-compute[74889]:         <nova:port uuid="68a05706-5ee9-4159-87e3-5ae063913646">
Nov 10 12:37:34 user nova-compute[74889]:           <nova:ip type="fixed" address="192.168.233.36" ipVersion="4"/>
Nov 10 12:37:34 user nova-compute[74889]:         </nova:port>
Nov 10 12:37:34 user nova-compute[74889]:       </nova:ports>
Nov 10 12:37:34 user nova-compute[74889]:     </nova:instance>
Nov 10 12:37:34 user nova-compute[74889]:   </metadata>
Nov 10 12:37:34 user nova-compute[74889]:   <sysinfo type="smbios">
Nov 10 12:37:34 user nova-compute[74889]:     <system>
Nov 10 12:37:34 user nova-compute[74889]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 12:37:34 user nova-compute[74889]:       <entry name="product">OpenStack Nova</entry>
Nov 10 12:37:34 user nova-compute[74889]:       <entry name="version">0.0.0</entry>
Nov 10 12:37:34 user nova-compute[74889]:       <entry name="serial">4da432d0-e586-410c-8231-720eee5b6d5a</entry>
Nov 10 12:37:34 user nova-compute[74889]:       <entry name="uuid">4da432d0-e586-410c-8231-720eee5b6d5a</entry>
Nov 10 12:37:34 user nova-compute[74889]:       <entry name="family">Virtual Machine</entry>
Nov 10 12:37:34 user nova-compute[74889]:     </system>
Nov 10 12:37:34 user nova-compute[74889]:   </sysinfo>
Nov 10 12:37:34 user nova-compute[74889]:   <os>
Nov 10 12:37:34 user nova-compute[74889]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 12:37:34 user nova-compute[74889]:     <boot dev="hd"/>
Nov 10 12:37:34 user nova-compute[74889]:     <smbios mode="sysinfo"/>
Nov 10 12:37:34 user nova-compute[74889]:   </os>
Nov 10 12:37:34 user nova-compute[74889]:   <features>
Nov 10 12:37:34 user nova-compute[74889]:     <acpi/>
Nov 10 12:37:34 user nova-compute[74889]:     <apic/>
Nov 10 12:37:34 user nova-compute[74889]:     <vmcoreinfo/>
Nov 10 12:37:34 user nova-compute[74889]:   </features>
Nov 10 12:37:34 user nova-compute[74889]:   <clock offset="utc">
Nov 10 12:37:34 user nova-compute[74889]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 12:37:34 user nova-compute[74889]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 12:37:34 user nova-compute[74889]:     <timer name="hpet" present="no"/>
Nov 10 12:37:34 user nova-compute[74889]:   </clock>
Nov 10 12:37:34 user nova-compute[74889]:   <cpu mode="custom" match="exact">
Nov 10 12:37:34 user nova-compute[74889]:     <model>Nehalem</model>
Nov 10 12:37:34 user nova-compute[74889]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 12:37:34 user nova-compute[74889]:   </cpu>
Nov 10 12:37:34 user nova-compute[74889]:   <devices>
Nov 10 12:37:34 user nova-compute[74889]:     <disk type="file" device="disk">
Nov 10 12:37:34 user nova-compute[74889]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 12:37:34 user nova-compute[74889]:       <source file="/opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk"/>
Nov 10 12:37:34 user nova-compute[74889]:       <target dev="vda" bus="virtio"/>
Nov 10 12:37:34 user nova-compute[74889]:     </disk>
Nov 10 12:37:34 user nova-compute[74889]:     <interface type="ethernet">
Nov 10 12:37:34 user nova-compute[74889]:       <mac address="fa:16:3e:bc:c3:91"/>
Nov 10 12:37:34 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:37:34 user nova-compute[74889]:       <mtu size="1442"/>
Nov 10 12:37:34 user nova-compute[74889]:       <target dev="tap68a05706-5e"/>
Nov 10 12:37:34 user nova-compute[74889]:     </interface>
Nov 10 12:37:34 user nova-compute[74889]:     <serial type="pty">
Nov 10 12:37:34 user nova-compute[74889]:       <log file="/opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/console.log" append="off"/>
Nov 10 12:37:34 user nova-compute[74889]:     </serial>
Nov 10 12:37:34 user nova-compute[74889]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 12:37:34 user nova-compute[74889]:     <video>
Nov 10 12:37:34 user nova-compute[74889]:       <model type="virtio"/>
Nov 10 12:37:34 user nova-compute[74889]:     </video>
Nov 10 12:37:34 user nova-compute[74889]:     <rng model="virtio">
Nov 10 12:37:34 user nova-compute[74889]:       <backend model="random">/dev/urandom</backend>
Nov 10 12:37:34 user nova-compute[74889]:     </rng>
Nov 10 12:37:34 user nova-compute[74889]:     <controller type="usb" index="0" model="none"/>
Nov 10 12:37:34 user nova-compute[74889]:     <memballoon model="virtio">
Nov 10 12:37:34 user nova-compute[74889]:       <stats period="10"/>
Nov 10 12:37:34 user nova-compute[74889]:     </memballoon>
Nov 10 12:37:34 user nova-compute[74889]:   </devices>
Nov 10 12:37:34 user nova-compute[74889]: </domain>
Nov 10 12:37:34 user nova-compute[74889]:  {{(pid=74889) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-6474602',display_name='tempest-VolumesNegativeTest-instance-6474602',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-6474602',id=52,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31ea0a5fb0c0417c915a56fab2a0211c',ramdisk_id='',reservation_id='r-xl09h3o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1976784778',owner_user_name='tempest-VolumesNegativeTest-1976784778-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T12:37:33Z,user_data=None,user_id='335613d504d64c4fabe16232182cbabf',uuid=4da432d0-e586-410c-8231-720eee5b6d5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Converting VIF {"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c3:91,bridge_name='br-int',has_traffic_filtering=True,id=68a05706-5ee9-4159-87e3-5ae063913646,network=Network(f265c298-ef0e-47bd-974d-1379d687e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a05706-5e') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG os_vif [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c3:91,bridge_name='br-int',has_traffic_filtering=True,id=68a05706-5ee9-4159-87e3-5ae063913646,network=Network(f265c298-ef0e-47bd-974d-1379d687e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a05706-5e') {{(pid=74889) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a77bd098-8906-5d50-9e57-16ca16738f08', '_type': 'linux-noop'}}, row=False) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68a05706-5e, may_exist=True, interface_attrs={}) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68a05706-5e, col_values=(('qos', UUID('9f4b52a8-a9c8-4a3e-8078-659916001ea6')),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68a05706-5e, col_values=(('external_ids', {'iface-id': '68a05706-5ee9-4159-87e3-5ae063913646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:c3:91', 'vm-uuid': '4da432d0-e586-410c-8231-720eee5b6d5a'}),), if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:34 user nova-compute[74889]: INFO os_vif [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:c3:91,bridge_name='br-int',has_traffic_filtering=True,id=68a05706-5ee9-4159-87e3-5ae063913646,network=Network(f265c298-ef0e-47bd-974d-1379d687e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a05706-5e')
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] No BDM found with device name vda, not building metadata. {{(pid=74889) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] No VIF found with MAC fa:16:3e:bc:c3:91, not building metadata {{(pid=74889) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:37:34 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Instance spawned successfully.
Nov 10 12:37:34 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-72e96946-c84f-4591-9f7a-6d0e1b3491d4 req-2776e9c2-ae0a-4b03-84b2-bca4d76dd021 service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Received event network-vif-plugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-72e96946-c84f-4591-9f7a-6d0e1b3491d4 req-2776e9c2-ae0a-4b03-84b2-bca4d76dd021 service nova] Acquiring lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-72e96946-c84f-4591-9f7a-6d0e1b3491d4 req-2776e9c2-ae0a-4b03-84b2-bca4d76dd021 service nova] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-72e96946-c84f-4591-9f7a-6d0e1b3491d4 req-2776e9c2-ae0a-4b03-84b2-bca4d76dd021 service nova] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.compute.manager [req-72e96946-c84f-4591-9f7a-6d0e1b3491d4 req-2776e9c2-ae0a-4b03-84b2-bca4d76dd021 service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] No waiting events found dispatching network-vif-plugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:37:35 user nova-compute[74889]: WARNING nova.compute.manager [req-72e96946-c84f-4591-9f7a-6d0e1b3491d4 req-2776e9c2-ae0a-4b03-84b2-bca4d76dd021 service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Received unexpected event network-vif-plugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 for instance with vm_state building and task_state spawning.
Nov 10 12:37:35 user nova-compute[74889]: INFO nova.compute.manager [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.compute.manager [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:37:35 user nova-compute[74889]: INFO nova.compute.manager [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Took 6.32 seconds to build instance.
Nov 10 12:37:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-d36da55f-9161-49fe-8a9d-77fc869249bb tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.479s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-ad7c4261-45e1-48a0-8184-d1baf2ecb023 req-f3a17f23-605f-4dde-982a-4ff9b7d65f70 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Updated VIF entry in instance network info cache for port 68a05706-5ee9-4159-87e3-5ae063913646. {{(pid=74889) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG nova.network.neutron [req-ad7c4261-45e1-48a0-8184-d1baf2ecb023 req-f3a17f23-605f-4dde-982a-4ff9b7d65f70 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Updating instance_info_cache with network_info: [{"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:37:35 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ad7c4261-45e1-48a0-8184-d1baf2ecb023 req-f3a17f23-605f-4dde-982a-4ff9b7d65f70 service nova] Releasing lock "refresh_cache-4da432d0-e586-410c-8231-720eee5b6d5a" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:37:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:36 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:37:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] No waiting events found dispatching network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:37:37 user nova-compute[74889]: WARNING nova.compute.manager [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received unexpected event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 for instance with vm_state building and task_state spawning.
Nov 10 12:37:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:37:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:37:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:37:37 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:37 user nova-compute[74889]: DEBUG nova.compute.manager [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] No waiting events found dispatching network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:37:37 user nova-compute[74889]: WARNING nova.compute.manager [req-de13febc-983c-49c5-acdc-42041b2886ca req-17e207d1-a98e-4c2d-8b8e-e27f02817e06 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received unexpected event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 for instance with vm_state building and task_state spawning.
Nov 10 12:37:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Instance event wait completed in 0 seconds for  {{(pid=74889) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 12:37:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Guest created on hypervisor {{(pid=74889) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 12:37:38 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Instance spawned successfully.
Nov 10 12:37:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 12:37:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Found default for hw_cdrom_bus of ide {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Found default for hw_disk_bus of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Found default for hw_input_bus of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Found default for hw_pointer_model of None {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Found default for hw_video_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:38 user nova-compute[74889]: DEBUG nova.virt.libvirt.driver [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Found default for hw_vif_model of virtio {{(pid=74889) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 12:37:38 user nova-compute[74889]: INFO nova.compute.manager [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 10 12:37:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Checking state {{(pid=74889) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 12:37:38 user nova-compute[74889]: INFO nova.compute.manager [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Took 5.88 seconds to build instance.
Nov 10 12:37:38 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-39b7d223-5253-49ba-8e0f-c61491d4e784 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "4da432d0-e586-410c-8231-720eee5b6d5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.977s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:37:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:40 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:50 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:55 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:37:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:00 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:05 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:38:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:15 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:38:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:38:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:38:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-e1237b62-0de4-4a75-82bc-0f4887e98249" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:38:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-e1237b62-0de4-4a75-82bc-0f4887e98249" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:38:15 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:38:15 user nova-compute[74889]: DEBUG nova.objects.instance [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lazy-loading 'info_cache' on Instance uuid e1237b62-0de4-4a75-82bc-0f4887e98249 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Updating instance_info_cache with network_info: [{"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-e1237b62-0de4-4a75-82bc-0f4887e98249" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:38:16 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:38:17 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:38:17 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.055343627929688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance e1237b62-0de4-4a75-82bc-0f4887e98249 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 4da432d0-e586-410c-8231-720eee5b6d5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing inventories for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating ProviderTree inventory for provider 07c73308-5a33-4ed2-81ea-818734657bdc from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Updating inventory in ProviderTree for provider 07c73308-5a33-4ed2-81ea-818734657bdc with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing aggregate associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, aggregates: None {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Refreshing trait associations for resource provider 07c73308-5a33-4ed2-81ea-818734657bdc, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=74889) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:38:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:38:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:19 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:38:22 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:38:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:38:25 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:38:29 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:38:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:38:34 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:38:39 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:44 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:48 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:38:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid e1237b62-0de4-4a75-82bc-0f4887e98249 {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:38:48 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Triggering sync for uuid 4da432d0-e586-410c-8231-720eee5b6d5a {{(pid=74889) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 12:38:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "e1237b62-0de4-4a75-82bc-0f4887e98249" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:38:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:38:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:38:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "4da432d0-e586-410c-8231-720eee5b6d5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:38:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:38:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "4da432d0-e586-410c-8231-720eee5b6d5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:38:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:38:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:38:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:38:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:38:49 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:54 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:38:59 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:04 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:09 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:39:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:39:14 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:15 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:39:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:39:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "refresh_cache-4da432d0-e586-410c-8231-720eee5b6d5a" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 12:39:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquired lock "refresh_cache-4da432d0-e586-410c-8231-720eee5b6d5a" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 12:39:15 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Forcefully refreshing network info cache for instance {{(pid=74889) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 12:39:15 user nova-compute[74889]: DEBUG nova.network.neutron [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Updating instance_info_cache with network_info: [{"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:39:15 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Releasing lock "refresh_cache-4da432d0-e586-410c-8231-720eee5b6d5a" {{(pid=74889) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 12:39:15 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Updated the network info_cache for instance {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 12:39:15 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:39:17 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:39:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:17 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:17 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:39:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:39:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:39:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:39:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:39:17 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk --force-share --output=json {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG oslo_concurrency.processutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74889) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 12:39:18 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:39:18 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:39:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=25.054637908935547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance e1237b62-0de4-4a75-82bc-0f4887e98249 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Instance 4da432d0-e586-410c-8231-720eee5b6d5a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74889) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:39:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:19 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:39:19 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:39:19 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:39:22 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:39:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "4da432d0-e586-410c-8231-720eee5b6d5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:22 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:22 user nova-compute[74889]: INFO nova.compute.manager [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Terminating instance
Nov 10 12:39:22 user nova-compute[74889]: DEBUG nova.compute.manager [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:39:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:22 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-773b891c-2ead-4dae-a17d-615eaf132527 req-0e7b98cf-0e96-4481-8c62-4a2edc9e9ea3 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-vif-unplugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-773b891c-2ead-4dae-a17d-615eaf132527 req-0e7b98cf-0e96-4481-8c62-4a2edc9e9ea3 service nova] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-773b891c-2ead-4dae-a17d-615eaf132527 req-0e7b98cf-0e96-4481-8c62-4a2edc9e9ea3 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-773b891c-2ead-4dae-a17d-615eaf132527 req-0e7b98cf-0e96-4481-8c62-4a2edc9e9ea3 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-773b891c-2ead-4dae-a17d-615eaf132527 req-0e7b98cf-0e96-4481-8c62-4a2edc9e9ea3 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] No waiting events found dispatching network-vif-unplugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG nova.compute.manager [req-773b891c-2ead-4dae-a17d-615eaf132527 req-0e7b98cf-0e96-4481-8c62-4a2edc9e9ea3 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-vif-unplugged-68a05706-5ee9-4159-87e3-5ae063913646 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:23 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Instance destroyed successfully.
Nov 10 12:39:23 user nova-compute[74889]: DEBUG nova.objects.instance [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lazy-loading 'resources' on Instance uuid 4da432d0-e586-410c-8231-720eee5b6d5a {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:37:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-6474602',display_name='tempest-VolumesNegativeTest-instance-6474602',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-6474602',id=52,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:37:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31ea0a5fb0c0417c915a56fab2a0211c',ramdisk_id='',reservation_id='r-xl09h3o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1976784778',owner_user_name='tempest-VolumesNegativeTest-1976784778-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:37:38Z,user_data=None,user_id='335613d504d64c4fabe16232182cbabf',uuid=4da432d0-e586-410c-8231-720eee5b6d5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Converting VIF {"id": "68a05706-5ee9-4159-87e3-5ae063913646", "address": "fa:16:3e:bc:c3:91", "network": {"id": "f265c298-ef0e-47bd-974d-1379d687e7a3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "315f0ead5a604acb8f6af0bfa5e2a85f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68a05706-5e", "ovs_interfaceid": "68a05706-5ee9-4159-87e3-5ae063913646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:c3:91,bridge_name='br-int',has_traffic_filtering=True,id=68a05706-5ee9-4159-87e3-5ae063913646,network=Network(f265c298-ef0e-47bd-974d-1379d687e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a05706-5e') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG os_vif [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:c3:91,bridge_name='br-int',has_traffic_filtering=True,id=68a05706-5ee9-4159-87e3-5ae063913646,network=Network(f265c298-ef0e-47bd-974d-1379d687e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a05706-5e') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68a05706-5e, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f4b52a8-a9c8-4a3e-8078-659916001ea6) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:39:23 user nova-compute[74889]: INFO os_vif [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:c3:91,bridge_name='br-int',has_traffic_filtering=True,id=68a05706-5ee9-4159-87e3-5ae063913646,network=Network(f265c298-ef0e-47bd-974d-1379d687e7a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68a05706-5e')
Nov 10 12:39:23 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Deleting instance files /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a_del
Nov 10 12:39:23 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Deletion of /opt/stack/data/nova/instances/4da432d0-e586-410c-8231-720eee5b6d5a_del complete
Nov 10 12:39:23 user nova-compute[74889]: INFO nova.compute.manager [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 10 12:39:23 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:39:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:39:24 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Took 0.61 seconds to deallocate network for instance.
Nov 10 12:39:24 user nova-compute[74889]: DEBUG nova.compute.manager [req-b28d0bf2-aa73-42bf-b9b3-98ddd15bcb1d req-747c5595-d67f-467f-b5df-7b3789cd3726 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-vif-deleted-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:39:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:24 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Deleted allocations for instance 4da432d0-e586-410c-8231-720eee5b6d5a
Nov 10 12:39:24 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-186bfc49-fb3e-4b7a-ac2b-369b94fee823 tempest-VolumesNegativeTest-1976784778 tempest-VolumesNegativeTest-1976784778-project-member] Lock "4da432d0-e586-410c-8231-720eee5b6d5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.837s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] No waiting events found dispatching network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:39:25 user nova-compute[74889]: WARNING nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received unexpected event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 for instance with vm_state deleted and task_state None.
Nov 10 12:39:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] No waiting events found dispatching network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:39:25 user nova-compute[74889]: WARNING nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received unexpected event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 for instance with vm_state deleted and task_state None.
Nov 10 12:39:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] No waiting events found dispatching network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:39:25 user nova-compute[74889]: WARNING nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received unexpected event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 for instance with vm_state deleted and task_state None.
Nov 10 12:39:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-vif-unplugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] No waiting events found dispatching network-vif-unplugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:39:25 user nova-compute[74889]: WARNING nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received unexpected event network-vif-unplugged-68a05706-5ee9-4159-87e3-5ae063913646 for instance with vm_state deleted and task_state None.
Nov 10 12:39:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Acquiring lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] Lock "4da432d0-e586-410c-8231-720eee5b6d5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:25 user nova-compute[74889]: DEBUG nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] No waiting events found dispatching network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:39:25 user nova-compute[74889]: WARNING nova.compute.manager [req-8cacd1a7-bfcd-4790-968f-8fc347fabcc2 req-8e939d16-c715-4ee0-842f-6e45c5b408b2 service nova] [instance: 4da432d0-e586-410c-8231-720eee5b6d5a] Received unexpected event network-vif-plugged-68a05706-5ee9-4159-87e3-5ae063913646 for instance with vm_state deleted and task_state None.
Nov 10 12:39:27 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:39:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:39:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:39:33 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:39:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:39:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:39:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:39:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:39:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:39:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:39:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:39:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:39:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:39:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:39:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Acquiring lock "e1237b62-0de4-4a75-82bc-0f4887e98249" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Acquiring lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:47 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:47 user nova-compute[74889]: INFO nova.compute.manager [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Terminating instance
Nov 10 12:39:47 user nova-compute[74889]: DEBUG nova.compute.manager [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Start destroying the instance on the hypervisor. {{(pid=74889) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-ae714a73-4b48-47f6-a0fb-6ad7e29a5ecf req-f1e239a2-3231-4bcf-8611-90e0e3675c27 service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Received event network-vif-unplugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ae714a73-4b48-47f6-a0fb-6ad7e29a5ecf req-f1e239a2-3231-4bcf-8611-90e0e3675c27 service nova] Acquiring lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ae714a73-4b48-47f6-a0fb-6ad7e29a5ecf req-f1e239a2-3231-4bcf-8611-90e0e3675c27 service nova] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-ae714a73-4b48-47f6-a0fb-6ad7e29a5ecf req-f1e239a2-3231-4bcf-8611-90e0e3675c27 service nova] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-ae714a73-4b48-47f6-a0fb-6ad7e29a5ecf req-f1e239a2-3231-4bcf-8611-90e0e3675c27 service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] No waiting events found dispatching network-vif-unplugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG nova.compute.manager [req-ae714a73-4b48-47f6-a0fb-6ad7e29a5ecf req-f1e239a2-3231-4bcf-8611-90e0e3675c27 service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Received event network-vif-unplugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 for instance with task_state deleting. {{(pid=74889) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: INFO nova.virt.libvirt.driver [-] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Instance destroyed successfully.
Nov 10 12:39:48 user nova-compute[74889]: DEBUG nova.objects.instance [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lazy-loading 'resources' on Instance uuid e1237b62-0de4-4a75-82bc-0f4887e98249 {{(pid=74889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG nova.virt.libvirt.vif [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T12:37:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-86900515',display_name='tempest-VolumesActionsTest-instance-86900515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-86900515',id=51,image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T12:37:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b439cc7ac4794aba9393c43999a62189',ramdisk_id='',reservation_id='r-rya7a6b5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b0074759-91cd-4b7c-8386-071a17ff617a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-41038633',owner_user_name='tempest-VolumesActionsTest-41038633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T12:37:35Z,user_data=None,user_id='6c62c3d49d3941f2bd6a972d4302259d',uuid=e1237b62-0de4-4a75-82bc-0f4887e98249,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Converting VIF {"id": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "address": "fa:16:3e:54:d4:38", "network": {"id": "cf66d50d-02c8-4cca-a7a3-9e33362b0b1e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-197645177-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b439cc7ac4794aba9393c43999a62189", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c80b7a-25", "ovs_interfaceid": "e9c80b7a-250c-4ebc-bf2f-6a5913cb1314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG nova.network.os_vif_util [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:d4:38,bridge_name='br-int',has_traffic_filtering=True,id=e9c80b7a-250c-4ebc-bf2f-6a5913cb1314,network=Network(cf66d50d-02c8-4cca-a7a3-9e33362b0b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c80b7a-25') {{(pid=74889) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG os_vif [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:d4:38,bridge_name='br-int',has_traffic_filtering=True,id=e9c80b7a-250c-4ebc-bf2f-6a5913cb1314,network=Network(cf66d50d-02c8-4cca-a7a3-9e33362b0b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c80b7a-25') {{(pid=74889) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9c80b7a-25, bridge=br-int, if_exists=True) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=222a1e5c-6f24-45bf-a7fb-61824e55ee94) {{(pid=74889) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:48 user nova-compute[74889]: INFO os_vif [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:d4:38,bridge_name='br-int',has_traffic_filtering=True,id=e9c80b7a-250c-4ebc-bf2f-6a5913cb1314,network=Network(cf66d50d-02c8-4cca-a7a3-9e33362b0b1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c80b7a-25')
Nov 10 12:39:48 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Deleting instance files /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249_del
Nov 10 12:39:48 user nova-compute[74889]: INFO nova.virt.libvirt.driver [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Deletion of /opt/stack/data/nova/instances/e1237b62-0de4-4a75-82bc-0f4887e98249_del complete
Nov 10 12:39:48 user nova-compute[74889]: INFO nova.compute.manager [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 12:39:48 user nova-compute[74889]: DEBUG oslo.service.loopingcall [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74889) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG nova.compute.manager [-] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Deallocating network for instance {{(pid=74889) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 12:39:48 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] deallocate_for_instance() {{(pid=74889) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 12:39:49 user nova-compute[74889]: DEBUG nova.network.neutron [-] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:39:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-55356c7e-a96d-4846-a101-33319df11a0f req-ef51f460-785b-4cc1-89a2-9c8fa6a12afc service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Received event network-vif-deleted-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:39:49 user nova-compute[74889]: INFO nova.compute.manager [req-55356c7e-a96d-4846-a101-33319df11a0f req-ef51f460-785b-4cc1-89a2-9c8fa6a12afc service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Neutron deleted interface e9c80b7a-250c-4ebc-bf2f-6a5913cb1314; detaching it from the instance and deleting it from the info cache
Nov 10 12:39:49 user nova-compute[74889]: DEBUG nova.network.neutron [req-55356c7e-a96d-4846-a101-33319df11a0f req-ef51f460-785b-4cc1-89a2-9c8fa6a12afc service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Updating instance_info_cache with network_info: [] {{(pid=74889) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 12:39:49 user nova-compute[74889]: INFO nova.compute.manager [-] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Took 0.48 seconds to deallocate network for instance.
Nov 10 12:39:49 user nova-compute[74889]: DEBUG nova.compute.manager [req-55356c7e-a96d-4846-a101-33319df11a0f req-ef51f460-785b-4cc1-89a2-9c8fa6a12afc service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Detach interface failed, port_id=e9c80b7a-250c-4ebc-bf2f-6a5913cb1314, reason: Instance e1237b62-0de4-4a75-82bc-0f4887e98249 could not be found. {{(pid=74889) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 12:39:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:49 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:39:49 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:39:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:49 user nova-compute[74889]: INFO nova.scheduler.client.report [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Deleted allocations for instance e1237b62-0de4-4a75-82bc-0f4887e98249
Nov 10 12:39:49 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-178b276c-72dc-4fb2-83cb-5428b28f153f tempest-VolumesActionsTest-41038633 tempest-VolumesActionsTest-41038633-project-member] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.711s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-edd6ed20-bbdd-49ca-896b-bbcf3825bd8d req-f478bda3-f2ac-474a-b5cf-cfcf1a52721d service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Received event network-vif-plugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 12:39:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-edd6ed20-bbdd-49ca-896b-bbcf3825bd8d req-f478bda3-f2ac-474a-b5cf-cfcf1a52721d service nova] Acquiring lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:39:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-edd6ed20-bbdd-49ca-896b-bbcf3825bd8d req-f478bda3-f2ac-474a-b5cf-cfcf1a52721d service nova] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:39:50 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [req-edd6ed20-bbdd-49ca-896b-bbcf3825bd8d req-f478bda3-f2ac-474a-b5cf-cfcf1a52721d service nova] Lock "e1237b62-0de4-4a75-82bc-0f4887e98249-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:39:50 user nova-compute[74889]: DEBUG nova.compute.manager [req-edd6ed20-bbdd-49ca-896b-bbcf3825bd8d req-f478bda3-f2ac-474a-b5cf-cfcf1a52721d service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] No waiting events found dispatching network-vif-plugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 {{(pid=74889) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 12:39:50 user nova-compute[74889]: WARNING nova.compute.manager [req-edd6ed20-bbdd-49ca-896b-bbcf3825bd8d req-f478bda3-f2ac-474a-b5cf-cfcf1a52721d service nova] [instance: e1237b62-0de4-4a75-82bc-0f4887e98249] Received unexpected event network-vif-plugged-e9c80b7a-250c-4ebc-bf2f-6a5913cb1314 for instance with vm_state deleted and task_state None.
Nov 10 12:39:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:39:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:39:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:39:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:39:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:39:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:40:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:40:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:40:12 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:40:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:40:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:40:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:40:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:40:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:40:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:40:17 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:40:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:40:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:40:17 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 12:40:17 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:40:18 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:40:18 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:40:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=9073MB free_disk=25.108779907226562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:40:18 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:40:22 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:40:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:40:28 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:40:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:40:30 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:40:31 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:40:31 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:40:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:40:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:40:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:40:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:40:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:40:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:41:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:41:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:41:13 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:41:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:41:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:41:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:41:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:41:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 12:41:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:41:19 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:41:19 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:41:19 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=9093MB free_disk=25.091121673583984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:41:19 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:41:20 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:41:20 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:41:23 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:41:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:41:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:41:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:41:32 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:41:32 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:41:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:41:34 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:41:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:41:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:41:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:41:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:41:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:41:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:41:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:41:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:41:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:41:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:41:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:41:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:41:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:41:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:41:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:10 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:13 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:14 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:18 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Starting heal instance info cache {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 12:42:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Rebuilding the list of instances to heal {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 12:42:18 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Didn't find any instances for network info cache update. {{(pid=74889) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 12:42:18 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Auditing locally available compute resources for user (node: user) {{(pid=74889) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 12:42:20 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:42:20 user nova-compute[74889]: WARNING nova.virt.libvirt.driver [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 12:42:20 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Hypervisor/Node resource view: name=user free_ram=9145MB free_disk=25.089012145996094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74889) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74889) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG nova.compute.provider_tree [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed in ProviderTree for provider: 07c73308-5a33-4ed2-81ea-818734657bdc {{(pid=74889) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG nova.scheduler.client.report [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Inventory has not changed for provider 07c73308-5a33-4ed2-81ea-818734657bdc based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74889) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG nova.compute.resource_tracker [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Compute_service record updated for user:user {{(pid=74889) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 12:42:20 user nova-compute[74889]: DEBUG oslo_concurrency.lockutils [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=74889) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 12:42:21 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:21 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:23 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:23 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:42:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:42:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:42:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:42:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:42:28 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:29 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:30 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 12:42:30 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] There are 0 instances to clean {{(pid=74889) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 12:42:33 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:33 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74889) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 12:42:33 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:38 user nova-compute[74889]: DEBUG oslo_service.periodic_task [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74889) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 12:42:38 user nova-compute[74889]: DEBUG nova.compute.manager [None req-7f3e5477-7ddb-4a95-85d0-3a4cb5f9fa6d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74889) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 12:42:38 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:43 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:42:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:42:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74889) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 12:42:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:42:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74889) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 12:42:48 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:53 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:42:58 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 12:43:03 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 12:43:08 user nova-compute[74889]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74889) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}